Nov 03 16:47:05 devstack cinder-volume[75874]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 03 16:47:05 devstack cinder-volume[75874]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 16:47:05 devstack cinder-volume[75874]: we strongly recommend against using it for new projects.
Nov 03 16:47:05 devstack cinder-volume[75874]: If you are already using Eventlet, we recommend migrating to a different
Nov 03 16:47:05 devstack cinder-volume[75874]: framework.  For more detail see
Nov 03 16:47:05 devstack cinder-volume[75874]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 16:47:05 devstack cinder-volume[75874]:   import eventlet  # noqa
Nov 03 16:47:08 devstack cinder-volume[75874]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75874) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:47:08 devstack cinder-volume[75874]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75874) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:47:08 devstack cinder-volume[75874]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75874) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:47:08 devstack cinder-volume[75874]: INFO dbcounter [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Registered counter for database cinder
Nov 03 16:47:08 devstack cinder-volume[75874]: DEBUG oslo_db.sqlalchemy.engines [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75874) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:47:09 devstack cinder-volume[75874]: DEBUG dbcounter [-] [75874] Writer thread running {{(pid=75874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 16:47:09 devstack cinder-volume[75874]: INFO cinder.rpc [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 03 16:47:09 devstack cinder-volume[75874]: INFO cinder.rpc [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 03 16:47:09 devstack cinder-volume[75874]: DEBUG oslo_db.sqlalchemy.engines [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75874) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:47:09 devstack cinder-volume[75874]: INFO cinder.volume.manager [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Determined volume DB was empty at startup.
Nov 03 16:47:09 devstack cinder-volume[75874]: DEBUG cinder.volume.manager [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75874) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 03 16:47:09 devstack cinder-volume[75874]: INFO cinder.volume.manager [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 03 16:47:09 devstack cinder-volume[75874]: WARNING stevedore.named [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 16:47:09 devstack cinder-volume[75874]: WARNING castellan.key_manager [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:47:09 devstack cinder-volume[75874]: WARNING cinder.keymgr.conf_key_mgr [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:47:09 devstack cinder-volume[75874]: DEBUG cinder.volume.drivers.lvm [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75874) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 03 16:47:09 devstack cinder-volume[75874]: DEBUG oslo_concurrency.processutils [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_concurrency.processutils [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] CMD "cinder-rtstool verify" returned: 0 in 0.522s {{(pid=75874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_db.sqlalchemy.engines [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75874) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:47:10 devstack cinder-volume[75874]: INFO cinder.rpc [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 03 16:47:10 devstack cinder-volume[75874]: INFO cinder.rpc [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 03 16:47:10 devstack cinder-volume[75874]: WARNING stevedore.named [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 16:47:10 devstack cinder-volume[75874]: WARNING castellan.key_manager [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:47:10 devstack cinder-volume[75874]: INFO cinder.volume.manager [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_db.sqlalchemy.engines [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75874) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:47:10 devstack cinder-volume[75874]: INFO oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Starting 1 workers
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Started child 76152 {{(pid=75874) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Full set of CONF: {{(pid=75874) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] ******************************************************************************** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Configuration options gathered from: {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] ================================================================================ {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] allow_availability_zone_fallback = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] allow_compression_on_image_upload = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] allowed_direct_url_schemes     = [] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] api_rate_limit                 = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] auth_strategy                  = keystone {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] az_cache_duration              = 3600 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_availability_zone      = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_host                   = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_name                   = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_stats_polling_interval = 60 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backup_api_class               = cinder.backup.api.API {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backup_name_template           = backup-%s {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[76152]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backup_use_same_host           = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backup_use_temp_snapshot       = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] chap_password                  = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] chap_username                  =  {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cinder_internal_tenant_project_id = 3c21852b73aa48cf8122de1e221c378d {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cinder_internal_tenant_user_id = c72ec9929b2d442cad1530aefde130be {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cloned_volume_same_az          = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cluster                        = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] compression_format             = gzip {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] compute_api_class              = cinder.compute.nova.API {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] config_dir                     = [] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] config_source                  = [] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] control_exchange               = openstack {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] debug                          = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] default_availability_zone      = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] default_group_type             = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] default_volume_type            = lvmdriver-1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] disk_geometry                  = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] driver_client_cert             = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] driver_client_cert_key         = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] driver_data_namespace          = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] driver_ssl_cert_path           = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] driver_ssl_cert_verify         = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] driver_use_ssl                 = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] enable_force_upload            = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] enable_new_services            = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] enable_unsupported_driver      = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] enforce_multipath_for_image_xfer = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] filter_function                = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance_api_insecure            = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance_api_servers             = ['http://192.168.122.57/image'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance_api_ssl_compression     = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance_ca_certificates_file    = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance_catalog_info            = image:glance:publicURL {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance_certfile                = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance_keyfile                 = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance_num_retries             = 3 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance_request_timeout         = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] goodness_function              = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] graceful_shutdown_timeout      = 5 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] group_api_class                = cinder.group.api.API {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] host                           = devstack {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] image_compress_on_upload       = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] image_conversion_address_space_limit = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] image_conversion_cpu_limit     = 60 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] image_conversion_disable       = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] image_introspection_address_space_limit = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] image_introspection_cpu_limit  = 60 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] image_upload_use_cinder_backend = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] image_upload_use_internal_tenant = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] image_volume_cache_enabled     = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] image_volume_cache_max_count   = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] image_volume_cache_max_size_gb = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] init_host_max_objects_retrieval = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] instance_format                = [instance: %(uuid)s]  {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] iscsi_target_flags             =  {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] iscsi_write_cache              = on {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] iser_helper                    = tgtadm {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] iser_ip_address                = 192.168.122.57 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] iser_port                      = 3260 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] log_color                      = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] log_config_append              = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] log_dir                        = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] log_file                       = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] log_options                    = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] log_rotate_interval            = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] log_rotate_interval_type       = days {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] log_rotation_type              = none {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] max_age                        = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] max_logfile_count              = 30 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] max_logfile_size_mb            = 200 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] max_over_subscription_ratio    = 20.0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] message_reap_interval          = 86400 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] message_ttl                    = 2592000 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] migration_create_volume_timeout_secs = 300 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] monkey_patch                   = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] monkey_patch_modules           = [] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] my_ip                          = 192.168.122.57 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] no_snapshot_gb_quota           = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] num_iser_scan_tries            = 3 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] num_shell_tries                = 3 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] num_volume_device_scan_tries   = 3 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] nvmeof_conn_info_version       = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] nvmet_ns_id                    = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] nvmet_port_id                  = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] osapi_max_limit                = 1000 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] osapi_volume_ext_list          = [] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] osapi_volume_listen_port       = 8776 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] osapi_volume_use_ssl           = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] osapi_volume_workers           = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] per_volume_size_limit          = -1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] periodic_fuzzy_delay           = 60 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] periodic_interval              = 60 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] public_endpoint                = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] publish_errors                 = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] quota_backup_gigabytes         = 1000 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] quota_backups                  = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] quota_gigabytes                = 1000 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] quota_groups                   = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] quota_snapshots                = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] quota_volumes                  = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] rate_limit_burst               = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] rate_limit_except_level        = CRITICAL {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] rate_limit_interval            = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] reinit_driver_count            = 3 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] replication_device             = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] report_discard_supported       = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] report_interval                = 120 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] reservation_clean_interval     = 86400 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] reservation_expire             = 86400 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] reserved_image_namespaces      = [] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] reserved_percentage            = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] rpc_response_timeout           = 120 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] run_external_periodic_tasks    = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] scst_target_driver             = iscsi {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] scst_target_iqn_name           = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] service_down_time              = 720 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] shell_completion               = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] snapshot_name_template         = snapshot-%s {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] snapshot_same_host             = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] split_loggers                  = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] state_path                     = /opt/stack/data/cinder {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] storage_availability_zone      = nova {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] storage_protocol               = iSCSI {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] syslog_log_facility            = LOG_USER {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] target_helper                  = lioadm {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] target_ip_address              = 192.168.122.57 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] target_port                    = 3260 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] target_protocol                = iscsi {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] target_secondary_ip_addresses  = [] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] trace_flags                    = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] transport_url                  = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] until_refresh                  = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[76152]: INFO cinder.volume.manager [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] use_chap_auth                  = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] use_default_quota_class        = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] use_journal                    = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] use_json                       = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] use_multipath_for_image_xfer   = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] use_stderr                     = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] use_syslog                     = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] verify_glance_signatures       = enabled {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] volume_api_class               = cinder.volume.api.API {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] volume_backend_name            = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] volume_clear                   = zero {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] volume_clear_ionice            = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] volume_clear_size              = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] volume_copy_bps_limit          = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] volume_dd_blocksize            = 1M {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] volume_name_template           = volume-%s {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] volume_service_inithost_offload = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] volume_usage_audit_period      = month {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] zoning_mode                    = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_concurrency.disable_process_locking = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.auth_section = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.auth_type   = password {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.auth_version = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.cache       = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.certfile    = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.delay_auth_decision = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.http_connect_timeout = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.include_service_catalog = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.insecure    = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.interface   = public {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.keyfile     = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_password = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcache_username = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.region_name = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.service_token_roles_required = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.service_type = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.token_cache_time = 300 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.57/identity {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.backend                  = dogpile.cache.null {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.backend_argument         = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.backend_expiration_time  = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.config_prefix            = cache.oslo {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.debug_cache_backend      = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.enable_retry_client      = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.enable_socket_keepalive  = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.enabled                  = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.expiration_time          = 600 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.hashclient_retry_attempts = 2 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.memcache_dead_retry      = 300 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.memcache_pool_maxsize    = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.memcache_sasl_enabled    = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.password                 = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.proxies                  = [] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.redis_db                 = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.redis_sentinel_service_name = mymaster {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.redis_server             = localhost:6379 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.retry_attempts           = 2 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.retry_delay              = 0.0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.socket_keepalive_count   = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.socket_keepalive_idle    = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.socket_keepalive_interval = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.socket_timeout           = 1.0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.tls_allowed_ciphers      = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.tls_cafile               = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.tls_certfile             = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.tls_enabled              = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.tls_keyfile              = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cache.username                 = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] coordination.backend_url       = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.asyncio_connection    = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.asyncio_slave_connection = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.backend               = sqlalchemy {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.connection            = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.connection_debug      = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.connection_parameters =  {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.connection_recycle_time = 3600 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.connection_trace      = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.db_inc_retry_interval = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.db_max_retries        = 20 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.db_max_retry_interval = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.db_retry_interval     = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.max_overflow          = 50 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.max_pool_size         = 5 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.max_retries           = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.mysql_wsrep_sync_wait = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.pool_timeout          = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.retry_interval        = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.slave_connection      = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.sqlite_synchronous    = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.synchronous_reader    = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] database.use_db_reconnect      = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_tracing.insecure = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler.connection_string     = messaging:// {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler.enabled               = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler.es_doc_type           = notification {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler.es_scroll_size        = 10000 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler.es_scroll_time        = 2m {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler.filter_error_trace    = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler.hmac_keys             = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler.sentinel_service_name = mymaster {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler.socket_timeout        = 0.1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler.trace_requests        = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler.trace_sqlalchemy      = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler_jaeger.process_tags   = {} {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler_jaeger.service_name_prefix = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] profiler_otlp.service_name_prefix = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_policy.enforce_new_defaults = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_policy.policy_default_rule = default {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_policy.policy_file        = policy.yaml {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] privsep_osbrick.group          = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] privsep_osbrick.helper_command = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] privsep_osbrick.user           = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cinder_sys_admin.group         = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cinder_sys_admin.helper_command = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] cinder_sys_admin.user          = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] service_user.auth_section      = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] service_user.auth_type         = password {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] service_user.cafile            = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] service_user.certfile          = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] service_user.collect_timing    = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] service_user.insecure          = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] service_user.keyfile           = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] service_user.send_service_user_token = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] service_user.split_loggers     = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] service_user.timeout           = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] service_user.tls_ciphers       = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] service_user.tls_min_version   = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance.auth_section            = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance.auth_type               = password {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance.certfile                = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance.collect_timing          = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance.insecure                = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance.keyfile                 = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance.region_name             = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance.split_loggers           = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance.timeout                 = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance.tls_ciphers             = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] glance.tls_min_version         = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.backend_availability_zone = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.chap_password = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.chap_username =  {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.disk_geometry = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.driver_client_cert = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.driver_client_cert_key = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.driver_data_namespace = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.driver_use_ssl = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.enable_unsupported_driver = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.extra_capabilities = {} {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.filter_function = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.goodness_function = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.iscsi_target_flags =  {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.iscsi_write_cache = on {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.iser_helper   = tgtadm {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.iser_ip_address = 192.168.122.57 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.iser_port     = 3260 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.lvm_share_target = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:10 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.lvm_type      = auto {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.num_shell_tries = 3 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.nvmet_port_id = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.replication_device = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.report_discard_supported = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.reserved_percentage = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.scst_target_driver = iscsi {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.scst_target_iqn_name = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.storage_protocol = iSCSI {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.target_helper = tgtadm {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.target_ip_address = 192.168.122.57 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.target_port   = 3260 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.target_protocol = iscsi {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.trace_flags   = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.unique_fqdn_network = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.use_chap_auth = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.volume_backend_name = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.volume_clear  = zero {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.volume_clear_ionice = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.volume_clear_size = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_reports.file_event_handler = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_reports.log_dir           = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.backend_availability_zone = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.backend_host       = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.chap_password      = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.chap_username      = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.disk_geometry      = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.driver_client_cert = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.driver_data_namespace = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.extra_capabilities = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.filter_function    = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.goodness_function  = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack sudo[76212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack sudo[76212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.iser_helper        = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.iser_ip_address    = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.iser_port          = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.iser_target_prefix = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.lvm_share_target   = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.lvm_type           = auto {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.num_shell_tries    = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.replication_device = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.report_discard_supported = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.reserved_percentage = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.scst_target_driver = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.storage_protocol   = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.target_helper      = lioadm {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.target_ip_address  = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.target_port        = 3260 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.trace_flags        = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.use_chap_auth      = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.volume_clear       = zero {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.volume_clear_size  = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] lvmdriver-1.volumes_dir        = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.ssl      = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_notifications.driver = [] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_notifications.retry = -1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] oslo_messaging_notifications.transport_url = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] key_manager.fixed_key          = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.barbican_api_version  = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.barbican_endpoint     = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.barbican_endpoint_type = public {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.barbican_region_name  = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.cafile                = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.certfile              = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.collect_timing        = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.insecure              = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.keyfile               = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.number_of_retries     = 60 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.retry_delay           = 1 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.send_service_user_token = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.split_loggers         = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.timeout               = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.tls_ciphers           = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.tls_min_version       = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.verify_ssl            = True {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican.verify_ssl_path       = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican_service_user.auth_section = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican_service_user.auth_type = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican_service_user.cafile   = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican_service_user.certfile = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican_service_user.collect_timing = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican_service_user.insecure = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican_service_user.keyfile  = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican_service_user.split_loggers = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican_service_user.timeout  = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican_service_user.tls_ciphers = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] barbican_service_user.tls_min_version = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.approle_role_id          = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.approle_secret_id        = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.auth_method              = approle {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.auth_path                = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.kv_mountpoint            = secret {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.kv_path                  = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.kv_version               = 2 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.namespace                = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.root_token_id            = **** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.ssl_ca_crt_file          = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.timeout                  = 60.0 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.token_file               = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.token_role               = None {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.use_ssl                  = False {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:47:10 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] ******************************************************************************** {{(pid=75874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 03 16:47:10 devstack sudo[76212]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:11 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:11 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:11 devstack sudo[76299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:47:11 devstack sudo[76299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:11 devstack sudo[76299]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:11 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.290s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:11 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:47:11 devstack cinder-volume[76152]: INFO cinder.brick.local_dev.lvm [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 03 16:47:11 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:11 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:11 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:11 devstack sudo[76385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:47:11 devstack sudo[76385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:11 devstack sudo[76385]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:11 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:11 devstack cinder-volume[76152]: DEBUG cinder.brick.local_dev.lvm [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76152) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 03 16:47:11 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:11 devstack sudo[76463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:47:11 devstack sudo[76463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:13 devstack sudo[76463]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:13 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.600s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:13 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:13 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:13 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:13 devstack sudo[76754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:47:13 devstack sudo[76754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:13 devstack sudo[76754]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:13 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.345s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:13 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:13 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:13 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:13 devstack sudo[76824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 03 16:47:13 devstack sudo[76824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:13 devstack sudo[76824]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:13 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.272s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:13 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:13 devstack sudo[76833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:47:13 devstack sudo[76833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:14 devstack sudo[76833]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:14 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:14 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:14 devstack sudo[76836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:47:14 devstack sudo[76836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:14 devstack sudo[76836]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:14 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:14 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:14 devstack sudo[76839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:47:14 devstack sudo[76839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:14 devstack sudo[76839]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:14 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:14 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:14 devstack sudo[76842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:47:14 devstack sudo[76842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:14 devstack sudo[76842]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:14 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:14 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:15 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:15 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:15 devstack sudo[76846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:47:15 devstack sudo[76846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:15 devstack sudo[76846]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:15 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:15 devstack cinder-volume[76152]: INFO cinder.volume.drivers.lvm [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 03 16:47:15 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:15 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:15 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:15 devstack sudo[76850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:47:15 devstack sudo[76850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:15 devstack sudo[76850]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:15 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:15 devstack cinder-volume[76152]: DEBUG cinder.volume.drivers.lvm [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Updating volume stats {{(pid=76152) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 16:47:15 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:15 devstack sudo[76854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:47:15 devstack sudo[76854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:15 devstack sudo[76854]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:15 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:15 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:15 devstack sudo[76858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:47:15 devstack sudo[76858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:16 devstack sudo[76858]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:16 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:16 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:16 devstack sudo[76861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:47:16 devstack sudo[76861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:16 devstack sudo[76861]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:16 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:16 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:16 devstack sudo[76864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:47:16 devstack sudo[76864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:16 devstack sudo[76864]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:16 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:16 devstack cinder-volume[76152]: INFO cinder.volume.driver [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Driver hasn't implemented _init_vendor_properties()
Nov 03 16:47:16 devstack cinder-volume[76152]: DEBUG cinder.volume.driver [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76152) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 03 16:47:16 devstack cinder-volume[76152]: DEBUG oslo_db.sqlalchemy.engines [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76152) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:47:16 devstack cinder-volume[76152]: DEBUG dbcounter [-] [76152] Writer thread running {{(pid=76152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 16:47:16 devstack cinder-volume[76152]: DEBUG cinder.db.api [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Building query based on filter {{(pid=76152) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 03 16:47:16 devstack cinder-volume[76152]: DEBUG cinder.image.image_utils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76152) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 03 16:47:16 devstack cinder-volume[76152]: INFO cinder.keymgr.migration [None req-3d2cd821-97c5-4b22-961d-e2c72af64bc3 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 03 16:47:17 devstack cinder-volume[76152]: DEBUG cinder.volume.drivers.lvm [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Updating volume stats {{(pid=76152) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 16:47:17 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:17 devstack sudo[76870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:47:17 devstack sudo[76870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:17 devstack sudo[76870]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:17 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:17 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:17 devstack sudo[76876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:47:17 devstack sudo[76876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:17 devstack sudo[76876]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:17 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:17 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:17 devstack sudo[76879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:47:17 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:17 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:17 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:17 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:17 devstack sudo[76883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:47:17 devstack sudo[76883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:18 devstack sudo[76883]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:18 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:18 devstack cinder-volume[76152]: DEBUG cinder.manager [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Notifying Schedulers of capabilities ... {{(pid=76152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:47:18 devstack cinder-volume[76152]: INFO cinder.volume.manager [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Driver initialization completed successfully.
Nov 03 16:47:18 devstack cinder-volume[76152]: INFO cinder.manager [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Initiating service 2 cleanup
Nov 03 16:47:18 devstack cinder-volume[76152]: INFO cinder.manager [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Service 2 cleanup completed.
Nov 03 16:47:18 devstack cinder-volume[76152]: DEBUG cinder.service [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Creating RPC server for service cinder-volume {{(pid=76152) start /opt/stack/cinder/cinder/service.py:231}}
Nov 03 16:47:18 devstack cinder-volume[76152]: DEBUG cinder.service [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76152) start /opt/stack/cinder/cinder/service.py:237}}
Nov 03 16:47:18 devstack cinder-volume[76152]: INFO cinder.volume.manager [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 03 16:47:18 devstack cinder-volume[76152]: DEBUG cinder.volume.drivers.lvm [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Updating volume stats {{(pid=76152) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 16:47:18 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:18 devstack sudo[76886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:47:18 devstack sudo[76886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:18 devstack sudo[76886]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:18 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:18 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:18 devstack sudo[76892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:47:18 devstack sudo[76892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:18 devstack sudo[76892]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:18 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:18 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:19 devstack sudo[76898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:47:19 devstack sudo[76898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:19 devstack sudo[76898]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:19 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:19 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:47:19 devstack sudo[76915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:47:19 devstack sudo[76915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:47:19 devstack sudo[76915]: pam_unix(sudo:session): session closed for user root
Nov 03 16:47:19 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:47:19 devstack cinder-volume[76152]: INFO cinder.volume.manager [None req-db69f10d-ac45-4585-8dba-2fa77f1d099d None None] Driver post RPC initialization completed successfully.
Nov 03 16:47:20 devstack cinder-volume[75874]: DEBUG dbcounter [-] [75874] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:47:29 devstack cinder-volume[76152]: DEBUG dbcounter [-] [76152] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:47:29 devstack cinder-volume[76152]: DEBUG dbcounter [-] [76152] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:47:47 devstack cinder-volume[76152]: DEBUG oslo_service.periodic_task [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running periodic task VolumeManager._thread_info {{(pid=76152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:47:47 devstack cinder-volume[76152]: DEBUG cinder.volume.manager [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] thread count: 6 {{(pid=76152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:47:47 devstack cinder-volume[76152]: DEBUG cinder.volume.manager [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] thread info: [<_MainThread(MainThread, started 138319521312896)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138319409343168)>, <Thread(Thread-3 (stat_writer), started daemon 138319408828160)>, <Thread(Rabbit-heartbeat, started daemon 138319406086912)>, <Thread(Thread-5 (_runner), started daemon 138319406438336)>, <Thread(Thread-7 (_runner), started daemon 138319406567488)>] {{(pid=76152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:48:47 devstack cinder-volume[76152]: DEBUG oslo_service.periodic_task [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:48:47 devstack cinder-volume[76152]: DEBUG cinder.volume.drivers.lvm [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Updating volume stats {{(pid=76152) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 16:48:47 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:48:47 devstack sudo[81908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:48:47 devstack sudo[81908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:48:47 devstack sudo[81908]: pam_unix(sudo:session): session closed for user root
Nov 03 16:48:47 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:48:47 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:48:47 devstack sudo[81911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:48:47 devstack sudo[81911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:48:48 devstack sudo[81911]: pam_unix(sudo:session): session closed for user root
Nov 03 16:48:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:48:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:48:48 devstack sudo[81953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:48:48 devstack sudo[81953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:48:48 devstack sudo[81953]: pam_unix(sudo:session): session closed for user root
Nov 03 16:48:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:48:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:48:48 devstack sudo[81957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:48:48 devstack sudo[81957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:48:48 devstack sudo[81957]: pam_unix(sudo:session): session closed for user root
Nov 03 16:48:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:48:48 devstack cinder-volume[76152]: DEBUG cinder.manager [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Notifying Schedulers of capabilities ... {{(pid=76152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:48:48 devstack cinder-volume[76152]: DEBUG oslo_service.periodic_task [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running periodic task VolumeManager._thread_info {{(pid=76152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:48:48 devstack cinder-volume[76152]: DEBUG cinder.volume.manager [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] thread count: 6 {{(pid=76152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:48:48 devstack cinder-volume[76152]: DEBUG cinder.volume.manager [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] thread info: [<_MainThread(MainThread, started 138319521312896)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138319409343168)>, <Thread(Thread-3 (stat_writer), started daemon 138319408828160)>, <Thread(Rabbit-heartbeat, started daemon 138319406086912)>, <Thread(Thread-5 (_runner), started daemon 138319406438336)>, <Thread(Thread-7 (_runner), started daemon 138319406567488)>] {{(pid=76152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:49:29 devstack cinder-volume[76152]: DEBUG dbcounter [-] [76152] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:49:47 devstack cinder-volume[76152]: DEBUG oslo_service.periodic_task [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:49:47 devstack cinder-volume[76152]: DEBUG cinder.volume.drivers.lvm [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Updating volume stats {{(pid=76152) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 16:49:47 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:49:47 devstack sudo[83317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:49:47 devstack sudo[83317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:49:47 devstack sudo[83317]: pam_unix(sudo:session): session closed for user root
Nov 03 16:49:47 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:49:47 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:49:47 devstack sudo[83325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:49:47 devstack sudo[83325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:49:48 devstack sudo[83325]: pam_unix(sudo:session): session closed for user root
Nov 03 16:49:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:49:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:49:48 devstack sudo[83328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:49:48 devstack sudo[83328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:49:48 devstack sudo[83328]: pam_unix(sudo:session): session closed for user root
Nov 03 16:49:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:49:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:49:48 devstack sudo[83376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:49:48 devstack sudo[83376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:49:48 devstack sudo[83376]: pam_unix(sudo:session): session closed for user root
Nov 03 16:49:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:49:48 devstack cinder-volume[76152]: DEBUG cinder.manager [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Notifying Schedulers of capabilities ... {{(pid=76152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:49:48 devstack cinder-volume[76152]: DEBUG oslo_service.periodic_task [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running periodic task VolumeManager._thread_info {{(pid=76152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:49:48 devstack cinder-volume[76152]: DEBUG cinder.volume.manager [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] thread count: 6 {{(pid=76152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:49:48 devstack cinder-volume[76152]: DEBUG cinder.volume.manager [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] thread info: [<_MainThread(MainThread, started 138319521312896)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138319409343168)>, <Thread(Thread-3 (stat_writer), started daemon 138319408828160)>, <Thread(Rabbit-heartbeat, started daemon 138319406086912)>, <Thread(Thread-5 (_runner), started daemon 138319406438336)>, <Thread(Thread-7 (_runner), started daemon 138319406567488)>] {{(pid=76152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:50:47 devstack cinder-volume[76152]: DEBUG oslo_service.periodic_task [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:50:47 devstack cinder-volume[76152]: DEBUG cinder.volume.drivers.lvm [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Updating volume stats {{(pid=76152) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 16:50:47 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:50:47 devstack sudo[84918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:50:47 devstack sudo[84918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:50:47 devstack sudo[84918]: pam_unix(sudo:session): session closed for user root
Nov 03 16:50:47 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:50:47 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:50:47 devstack sudo[84922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:50:47 devstack sudo[84922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:50:48 devstack sudo[84922]: pam_unix(sudo:session): session closed for user root
Nov 03 16:50:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:50:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:50:48 devstack sudo[84925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:50:48 devstack sudo[84925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:50:48 devstack sudo[84925]: pam_unix(sudo:session): session closed for user root
Nov 03 16:50:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:50:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:50:48 devstack sudo[84939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:50:48 devstack sudo[84939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:50:48 devstack sudo[84939]: pam_unix(sudo:session): session closed for user root
Nov 03 16:50:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:50:48 devstack cinder-volume[76152]: DEBUG cinder.manager [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Notifying Schedulers of capabilities ... {{(pid=76152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:50:48 devstack cinder-volume[76152]: DEBUG oslo_service.periodic_task [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running periodic task VolumeManager._thread_info {{(pid=76152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:50:48 devstack cinder-volume[76152]: DEBUG cinder.volume.manager [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] thread count: 6 {{(pid=76152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:50:48 devstack cinder-volume[76152]: DEBUG cinder.volume.manager [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] thread info: [<_MainThread(MainThread, started 138319521312896)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138319409343168)>, <Thread(Thread-3 (stat_writer), started daemon 138319408828160)>, <Thread(Rabbit-heartbeat, started daemon 138319406086912)>, <Thread(Thread-5 (_runner), started daemon 138319406438336)>, <Thread(Thread-7 (_runner), started daemon 138319406567488)>] {{(pid=76152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:51:29 devstack cinder-volume[76152]: DEBUG dbcounter [-] [76152] Writing DB stats cinder:SELECT=1 {{(pid=76152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:51:29 devstack cinder-volume[76152]: DEBUG dbcounter [-] [76152] Writing DB stats cinder:UPDATE=1 {{(pid=76152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:51:47 devstack cinder-volume[76152]: DEBUG oslo_service.periodic_task [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:51:47 devstack cinder-volume[76152]: DEBUG cinder.volume.drivers.lvm [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Updating volume stats {{(pid=76152) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 16:51:47 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:51:47 devstack sudo[86059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:51:47 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:51:47 devstack cinder-volume[75874]: INFO oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Caught SIGTERM, stopping children
Nov 03 16:51:47 devstack cinder-volume[75874]: DEBUG oslo_concurrency.lockutils [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Acquiring lock "singleton_lock" {{(pid=75874) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:51:47 devstack cinder-volume[75874]: DEBUG oslo_concurrency.lockutils [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Acquired lock "singleton_lock" {{(pid=75874) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:51:47 devstack cinder-volume[75874]: DEBUG oslo_concurrency.lockutils [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Releasing lock "singleton_lock" {{(pid=75874) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:51:47 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Stop services. {{(pid=75874) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 03 16:51:47 devstack cinder-volume[75874]: DEBUG oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Killing children. {{(pid=75874) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 03 16:51:47 devstack cinder-volume[75874]: INFO oslo_service.backend._eventlet.service [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Waiting on 1 children to exit
Nov 03 16:51:47 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root
Nov 03 16:51:47 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:51:47 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:51:47 devstack sudo[86066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:51:47 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:51:48 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root
Nov 03 16:51:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:51:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:51:48 devstack sudo[86069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:51:48 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:51:48 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root
Nov 03 16:51:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:51:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:51:48 devstack sudo[86072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:51:48 devstack sudo[86072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:51:48 devstack sudo[86072]: pam_unix(sudo:session): session closed for user root
Nov 03 16:51:48 devstack cinder-volume[76152]: DEBUG oslo_concurrency.processutils [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:51:48 devstack cinder-volume[76152]: DEBUG cinder.manager [None req-0d15eb16-93aa-4efc-b6f9-3a1e610c6513 None None] Notifying Schedulers of capabilities ... {{(pid=76152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:51:52 devstack cinder-volume[76152]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Nov 03 16:51:53 devstack cinder-volume[86079]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 03 16:51:53 devstack cinder-volume[86079]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 16:51:53 devstack cinder-volume[86079]: we strongly recommend against using it for new projects.
Nov 03 16:51:53 devstack cinder-volume[86079]: If you are already using Eventlet, we recommend migrating to a different
Nov 03 16:51:53 devstack cinder-volume[86079]: framework.  For more detail see
Nov 03 16:51:53 devstack cinder-volume[86079]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 16:51:53 devstack cinder-volume[86079]:   import eventlet  # noqa
Nov 03 16:51:53 devstack cinder-volume[76152]: DEBUG oslo_concurrency.lockutils [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Acquiring lock "singleton_lock" {{(pid=76152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:51:53 devstack cinder-volume[76152]: DEBUG oslo_concurrency.lockutils [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Acquired lock "singleton_lock" {{(pid=76152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:51:53 devstack cinder-volume[76152]: DEBUG oslo_concurrency.lockutils [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Releasing lock "singleton_lock" {{(pid=76152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:51:53 devstack cinder-volume[76152]: WARNING amqp [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 16:51:53 devstack cinder-volume[76152]: WARNING amqp [None req-0c07a9a4-3cc1-41f3-9597-de20729114fd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 16:51:55 devstack cinder-volume[86079]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86079) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:51:55 devstack cinder-volume[86079]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86079) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:51:55 devstack cinder-volume[86079]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86079) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:51:55 devstack cinder-volume[86079]: INFO dbcounter [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Registered counter for database cinder
Nov 03 16:51:55 devstack cinder-volume[86079]: DEBUG oslo_db.sqlalchemy.engines [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86079) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG dbcounter [-] [86079] Writer thread running {{(pid=86079) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 16:51:56 devstack cinder-volume[86079]: INFO cinder.rpc [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 03 16:51:56 devstack cinder-volume[86079]: INFO cinder.rpc [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_db.sqlalchemy.engines [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86079) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:51:56 devstack cinder-volume[86079]: INFO cinder.volume.manager [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Determined volume DB was empty at startup.
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG cinder.volume.manager [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86079) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 03 16:51:56 devstack cinder-volume[86079]: INFO cinder.volume.manager [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 03 16:51:56 devstack cinder-volume[86079]: WARNING stevedore.named [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 16:51:56 devstack cinder-volume[86079]: WARNING castellan.key_manager [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:51:56 devstack cinder-volume[86079]: WARNING cinder.keymgr.conf_key_mgr [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:51:56 devstack cinder-volume[86079]: INFO cinder.volume.manager [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_db.sqlalchemy.engines [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86079) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:51:56 devstack cinder-volume[86079]: INFO oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Starting 1 workers
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Started child 86296 {{(pid=86079) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Full set of CONF: {{(pid=86079) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 03 16:51:56 devstack cinder-volume[86296]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] ******************************************************************************** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Configuration options gathered from: {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] ================================================================================ {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] allow_availability_zone_fallback = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] allow_compression_on_image_upload = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] allowed_direct_url_schemes     = [] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] api_rate_limit                 = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] auth_strategy                  = keystone {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_availability_zone      = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_host                   = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_name                   = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_stats_polling_interval = 60 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backup_api_class               = cinder.backup.api.API {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backup_name_template           = backup-%s {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backup_use_same_host           = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backup_use_temp_snapshot       = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] chap_password                  = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] chap_username                  =  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cinder_internal_tenant_project_id = 3c21852b73aa48cf8122de1e221c378d {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cinder_internal_tenant_user_id = c72ec9929b2d442cad1530aefde130be {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cluster                        = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] compression_format             = gzip {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] config_dir                     = [] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] config_source                  = [] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] control_exchange               = openstack {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] debug                          = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] default_availability_zone      = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] default_group_type             = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] default_volume_type            = QuobyteHD {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] disk_geometry                  = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] driver_client_cert             = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] driver_client_cert_key         = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] driver_data_namespace          = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] driver_ssl_cert_path           = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] driver_ssl_cert_verify         = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] driver_use_ssl                 = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] enable_new_services            = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] enable_unsupported_driver      = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] enforce_multipath_for_image_xfer = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] filter_function                = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance_api_insecure            = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance_api_servers             = ['http://192.168.122.57/image'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance_api_ssl_compression     = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance_ca_certificates_file    = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance_certfile                = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance_keyfile                 = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance_num_retries             = 3 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance_request_timeout         = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] goodness_function              = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] graceful_shutdown_timeout      = 5 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] group_api_class                = cinder.group.api.API {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] host                           = devstack {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] image_compress_on_upload       = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] image_conversion_address_space_limit = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] image_conversion_cpu_limit     = 60 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] image_conversion_disable       = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] image_introspection_address_space_limit = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] image_introspection_cpu_limit  = 60 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] image_upload_use_cinder_backend = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] image_upload_use_internal_tenant = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] image_volume_cache_enabled     = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] image_volume_cache_max_count   = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] image_volume_cache_max_size_gb = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] init_host_max_objects_retrieval = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] iscsi_target_flags             =  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] iscsi_write_cache              = on {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] iser_helper                    = tgtadm {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] iser_ip_address                = 192.168.122.57 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] iser_port                      = 3260 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] log_color                      = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86296]: INFO cinder.volume.manager [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 03 16:51:56 devstack cinder-volume[86296]: DEBUG cinder.volume.drivers.remotefs [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86296) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] log_config_append              = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] log_dir                        = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] log_file                       = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] log_options                    = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] log_rotate_interval            = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] log_rotate_interval_type       = days {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] log_rotation_type              = none {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] max_age                        = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] max_logfile_count              = 30 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] max_logfile_size_mb            = 200 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] max_over_subscription_ratio    = 20.0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] message_reap_interval          = 86400 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] message_ttl                    = 2592000 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] migration_create_volume_timeout_secs = 300 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] monkey_patch                   = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] monkey_patch_modules           = [] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] my_ip                          = 192.168.122.57 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] no_snapshot_gb_quota           = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] num_iser_scan_tries            = 3 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] num_shell_tries                = 3 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] num_volume_device_scan_tries   = 3 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] nvmeof_conn_info_version       = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] nvmet_ns_id                    = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] nvmet_port_id                  = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] osapi_max_limit                = 1000 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] osapi_volume_ext_list          = [] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] osapi_volume_listen_port       = 8776 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] osapi_volume_use_ssl           = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] osapi_volume_workers           = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] per_volume_size_limit          = -1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] periodic_fuzzy_delay           = 60 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] periodic_interval              = 60 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] public_endpoint                = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] publish_errors                 = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] quota_backup_gigabytes         = 1000 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] quota_backups                  = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] quota_gigabytes                = 1000 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] quota_groups                   = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] quota_snapshots                = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] quota_volumes                  = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] rate_limit_burst               = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] rate_limit_except_level        = CRITICAL {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] rate_limit_interval            = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] reinit_driver_count            = 3 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] replication_device             = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] report_discard_supported       = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] report_interval                = 120 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] reservation_clean_interval     = 86400 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] reservation_expire             = 86400 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] reserved_image_namespaces      = [] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] reserved_percentage            = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] rpc_response_timeout           = 120 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] run_external_periodic_tasks    = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] scst_target_driver             = iscsi {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] scst_target_iqn_name           = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] service_down_time              = 720 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] shell_completion               = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] snapshot_name_template         = snapshot-%s {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] split_loggers                  = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] state_path                     = /opt/stack/data/cinder {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] storage_availability_zone      = nova {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] storage_protocol               = iSCSI {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] syslog_log_facility            = LOG_USER {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] target_helper                  = lioadm {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] target_ip_address              = 192.168.122.57 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] target_port                    = 3260 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] target_protocol                = iscsi {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] target_secondary_ip_addresses  = [] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] trace_flags                    = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] transport_url                  = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] until_refresh                  = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] use_chap_auth                  = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] use_default_quota_class        = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] use_journal                    = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] use_json                       = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] use_multipath_for_image_xfer   = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] use_stderr                     = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] use_syslog                     = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] verify_glance_signatures       = enabled {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] volume_api_class               = cinder.volume.api.API {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] volume_backend_name            = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] volume_clear                   = zero {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] volume_clear_ionice            = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] volume_clear_size              = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] volume_copy_bps_limit          = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] volume_dd_blocksize            = 1M {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] volume_name_template           = volume-%s {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] volume_service_inithost_offload = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] volume_usage_audit_period      = month {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] zoning_mode                    = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_concurrency.disable_process_locking = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.auth_section = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.auth_type   = password {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.auth_version = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.cache       = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.certfile    = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.include_service_catalog = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.insecure    = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.interface   = public {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.keyfile     = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_password = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcache_username = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.region_name = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.service_type = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.57/identity {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.backend                  = dogpile.cache.null {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.backend_argument         = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.backend_expiration_time  = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.config_prefix            = cache.oslo {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.debug_cache_backend      = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.enable_retry_client      = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.enable_socket_keepalive  = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.enabled                  = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.expiration_time          = 600 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.hashclient_retry_attempts = 2 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.memcache_dead_retry      = 300 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.memcache_sasl_enabled    = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.password                 = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.proxies                  = [] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.redis_db                 = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.redis_server             = localhost:6379 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.retry_attempts           = 2 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.retry_delay              = 0.0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.socket_keepalive_count   = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.socket_keepalive_idle    = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.socket_keepalive_interval = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.socket_timeout           = 1.0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.tls_allowed_ciphers      = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.tls_cafile               = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.tls_certfile             = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.tls_enabled              = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.tls_keyfile              = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cache.username                 = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] coordination.backend_url       = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.asyncio_connection    = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.asyncio_slave_connection = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.backend               = sqlalchemy {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.connection            = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.connection_debug      = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.connection_parameters =  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.connection_recycle_time = 3600 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.connection_trace      = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.db_inc_retry_interval = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.db_max_retries        = 20 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.db_max_retry_interval = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.db_retry_interval     = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.max_overflow          = 50 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.max_pool_size         = 5 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.max_retries           = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.mysql_wsrep_sync_wait = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.pool_timeout          = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.retry_interval        = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.slave_connection      = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.sqlite_synchronous    = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.synchronous_reader    = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] database.use_db_reconnect      = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_tracing.insecure = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler.connection_string     = messaging:// {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler.enabled               = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler.es_doc_type           = notification {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler.es_scroll_size        = 10000 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler.es_scroll_time        = 2m {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86296]: DEBUG cinder.volume.drivers.quobyte [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86296) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler.filter_error_trace    = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler.hmac_keys             = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler.sentinel_service_name = mymaster {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler.socket_timeout        = 0.1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler.trace_requests        = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler.trace_sqlalchemy      = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler_jaeger.process_tags   = {} {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86296]: WARNING cinder.volume.drivers.quobyte [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler_jaeger.service_name_prefix = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86296]: WARNING cinder.volume.drivers.quobyte [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] profiler_otlp.service_name_prefix = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_policy.enforce_new_defaults = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_policy.policy_default_rule = default {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86296]: DEBUG oslo_concurrency.processutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Running cmd (subprocess): mount.quobyte {{(pid=86296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] privsep_osbrick.group          = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] privsep_osbrick.helper_command = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] privsep_osbrick.user           = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cinder_sys_admin.group         = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cinder_sys_admin.helper_command = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] cinder_sys_admin.user          = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] service_user.auth_section      = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] service_user.auth_type         = password {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] service_user.cafile            = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] service_user.certfile          = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] service_user.collect_timing    = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] service_user.insecure          = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] service_user.keyfile           = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] service_user.send_service_user_token = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] service_user.split_loggers     = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] service_user.timeout           = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] service_user.tls_ciphers       = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] service_user.tls_min_version   = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance.auth_section            = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance.auth_type               = password {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance.certfile                = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance.collect_timing          = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance.insecure                = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance.keyfile                 = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance.region_name             = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance.split_loggers           = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance.timeout                 = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance.tls_ciphers             = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] glance.tls_min_version         = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.backend_availability_zone = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.chap_password = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.chap_username =  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.disk_geometry = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.driver_client_cert = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.driver_client_cert_key = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.driver_data_namespace = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.driver_use_ssl = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.extra_capabilities = {} {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.filter_function = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.goodness_function = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.iscsi_target_flags =  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.iscsi_write_cache = on {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.iser_ip_address = 192.168.122.57 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.iser_port     = 3260 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.nas_host      =  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.nas_login     = admin {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.nas_mount_options = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.nas_password  = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.nas_private_key =  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.nas_share_path =  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.num_shell_tries = 3 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.quobyte_volume_url = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.replication_device = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.report_discard_supported = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.reserved_percentage = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.target_helper = tgtadm {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.target_ip_address = 192.168.122.57 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.target_port   = 3260 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.target_protocol = iscsi {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.trace_flags   = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.unique_fqdn_network = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.use_chap_auth = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.volume_backend_name = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.volume_clear  = zero {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.volume_clear_ionice = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.volume_clear_size = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_reports.file_event_handler = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_reports.log_dir           = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.backend_availability_zone = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.backend_host         = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.chap_password        = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.chap_username        = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.disk_geometry        = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.driver_client_cert   = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.driver_data_namespace = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.extra_capabilities   = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.filter_function      = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.goodness_function    = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.iser_helper          = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.iser_ip_address      = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.iser_port            = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.nas_host             = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.nas_login            = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.nas_mount_options    = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.nas_password         = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.nas_private_key      = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack quobyte-client[86297]: Reading configuration file: /etc/quobyte/client.cfg
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.nas_share_path       = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack quobyte-client[86297]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.num_shell_tries      = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.replication_device   = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.report_discard_supported = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.reserved_percentage  = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.scst_target_driver   = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.storage_protocol     = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.target_helper        = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86296]: DEBUG oslo_concurrency.processutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] CMD "mount.quobyte" returned: 1 in 0.106s {{(pid=86296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:51:56 devstack cinder-volume[86296]: DEBUG oslo_concurrency.lockutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86296) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:51:56 devstack cinder-volume[86296]: DEBUG oslo_concurrency.lockutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86296) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:51:56 devstack cinder-volume[86296]: DEBUG cinder.volume.drivers.quobyte [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=86296) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.target_ip_address    = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.target_port          = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.target_prefix        = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.target_protocol      = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.trace_flags          = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.use_chap_auth        = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86296]: INFO cinder.volume.drivers.quobyte [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 ...
Nov 03 16:51:56 devstack cinder-volume[86296]: DEBUG oslo_concurrency.processutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 -c /etc/quobyte/client-cinder.cfg {{(pid=86296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.volume_clear         = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.volume_clear_size    = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] QuobyteHD.volumes_dir          = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_notifications.driver = [] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_notifications.retry = -1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] key_manager.fixed_key          = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.barbican_api_version  = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.barbican_endpoint     = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.barbican_endpoint_type = public {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.barbican_region_name  = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.cafile                = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.certfile              = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.collect_timing        = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.insecure              = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.keyfile               = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.number_of_retries     = 60 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.retry_delay           = 1 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:56 devstack sudo[86298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 -c /etc/quobyte/client-cinder.cfg
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.send_service_user_token = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.split_loggers         = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.timeout               = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.tls_ciphers           = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.tls_min_version       = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.verify_ssl            = True {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican.verify_ssl_path       = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican_service_user.auth_section = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican_service_user.auth_type = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican_service_user.cafile   = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican_service_user.certfile = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican_service_user.collect_timing = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican_service_user.insecure = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican_service_user.keyfile  = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican_service_user.split_loggers = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican_service_user.timeout  = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican_service_user.tls_ciphers = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] barbican_service_user.tls_min_version = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.approle_role_id          = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.approle_secret_id        = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.auth_method              = approle {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.auth_path                = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.kv_mountpoint            = secret {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.kv_path                  = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.kv_version               = 2 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.namespace                = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.root_token_id            = **** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.ssl_ca_crt_file          = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.timeout                  = 60.0 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.token_file               = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.token_role               = None {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.use_ssl                  = False {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:51:57 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] ******************************************************************************** {{(pid=86079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 03 16:51:57 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root
Nov 03 16:51:57 devstack cinder-volume[86296]: DEBUG oslo_concurrency.processutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.532s {{(pid=86296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:51:57 devstack cinder-volume[86296]: INFO cinder.volume.drivers.quobyte [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 succeeded
Nov 03 16:51:57 devstack cinder-volume[86296]: DEBUG cinder.volume.drivers.quobyte [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=86296) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:51:57 devstack cinder-volume[86296]: DEBUG oslo_concurrency.lockutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.551s {{(pid=86296) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:51:57 devstack cinder-volume[86296]: DEBUG oslo_concurrency.processutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=86296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:51:57 devstack sudo[86408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:51:57 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:51:57 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root
Nov 03 16:51:57 devstack cinder-volume[86296]: DEBUG oslo_concurrency.processutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.383s {{(pid=86296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:51:57 devstack cinder-volume[86296]: INFO cinder.volume.driver [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Driver hasn't implemented _init_vendor_properties()
Nov 03 16:51:57 devstack cinder-volume[86296]: DEBUG cinder.volume.driver [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7029113769531, 'free_capacity_gb': 1773.7029113769531, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86296) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 03 16:51:57 devstack cinder-volume[86296]: DEBUG oslo_db.sqlalchemy.engines [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:51:57 devstack cinder-volume[86296]: DEBUG dbcounter [-] [86296] Writer thread running {{(pid=86296) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG cinder.db.api [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Building query based on filter {{(pid=86296) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG cinder.image.image_utils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86296) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 03 16:51:58 devstack cinder-volume[86296]: INFO cinder.keymgr.migration [None req-ae7ead77-4ca4-403e-8131-6d964a0bb33c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG oslo_concurrency.lockutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86296) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG oslo_concurrency.lockutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86296) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG cinder.volume.drivers.quobyte [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=86296) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG cinder.volume.drivers.quobyte [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=86296) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG oslo_concurrency.lockutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86296) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG oslo_concurrency.processutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=86296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:51:58 devstack sudo[86421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:51:58 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:51:58 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG oslo_concurrency.processutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.259s {{(pid=86296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG cinder.manager [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Notifying Schedulers of capabilities ... {{(pid=86296) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:51:58 devstack cinder-volume[86296]: INFO cinder.volume.manager [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Driver initialization completed successfully.
Nov 03 16:51:58 devstack cinder-volume[86296]: INFO cinder.manager [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Initiating service 3 cleanup
Nov 03 16:51:58 devstack cinder-volume[86296]: INFO cinder.manager [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Service 3 cleanup completed.
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG cinder.service [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Creating RPC server for service cinder-volume {{(pid=86296) start /opt/stack/cinder/cinder/service.py:231}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG cinder.service [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86296) start /opt/stack/cinder/cinder/service.py:237}}
Nov 03 16:51:58 devstack cinder-volume[86296]: INFO cinder.volume.manager [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG oslo_concurrency.lockutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86296) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG oslo_concurrency.lockutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86296) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG cinder.volume.drivers.quobyte [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=86296) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG cinder.volume.drivers.quobyte [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=86296) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG oslo_concurrency.lockutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86296) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG oslo_concurrency.processutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=86296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:51:58 devstack sudo[86431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:51:58 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:51:58 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root
Nov 03 16:51:58 devstack cinder-volume[86296]: DEBUG oslo_concurrency.processutils [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.356s {{(pid=86296) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:51:58 devstack cinder-volume[86296]: INFO cinder.volume.manager [None req-2ca25274-3615-478b-ad30-e5bc0f74871e None None] Driver post RPC initialization completed successfully.
Nov 03 16:52:03 devstack cinder-volume[86079]: INFO oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Caught SIGTERM, stopping children
Nov 03 16:52:03 devstack cinder-volume[86079]: DEBUG oslo_concurrency.lockutils [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Acquiring lock "singleton_lock" {{(pid=86079) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:52:03 devstack cinder-volume[86079]: DEBUG oslo_concurrency.lockutils [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Acquired lock "singleton_lock" {{(pid=86079) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:52:03 devstack cinder-volume[86079]: DEBUG oslo_concurrency.lockutils [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Releasing lock "singleton_lock" {{(pid=86079) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:52:03 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Stop services. {{(pid=86079) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 03 16:52:03 devstack cinder-volume[86079]: DEBUG oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Killing children. {{(pid=86079) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 03 16:52:03 devstack cinder-volume[86079]: INFO oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Waiting on 1 children to exit
Nov 03 16:52:04 devstack cinder-volume[86296]: DEBUG oslo_service.periodic_task [None req-91da5f86-d2a1-43aa-b22a-8ef445c74987 None None] Running periodic task VolumeManager._thread_info {{(pid=86296) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:52:04 devstack cinder-volume[86296]: DEBUG cinder.volume.manager [None req-91da5f86-d2a1-43aa-b22a-8ef445c74987 None None] thread count: 6 {{(pid=86296) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:52:04 devstack cinder-volume[86296]: DEBUG cinder.volume.manager [None req-91da5f86-d2a1-43aa-b22a-8ef445c74987 None None] thread info: [<_MainThread(MainThread, started 139236970668160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139236859066880)>, <Thread(Thread-3 (stat_writer), started daemon 139236857132736)>, <Thread(Rabbit-heartbeat, started daemon 139236856472000)>, <Thread(Thread-5 (_runner), started daemon 139236854510720)>, <Thread(Thread-7 (_runner), started daemon 139236854496192)>] {{(pid=86296) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:52:06 devstack cinder-volume[86296]: DEBUG oslo_concurrency.lockutils [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Acquiring lock "singleton_lock" {{(pid=86296) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:52:06 devstack cinder-volume[86296]: DEBUG oslo_concurrency.lockutils [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Acquired lock "singleton_lock" {{(pid=86296) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:52:06 devstack cinder-volume[86296]: DEBUG oslo_concurrency.lockutils [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Releasing lock "singleton_lock" {{(pid=86296) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:52:06 devstack cinder-volume[86296]: WARNING amqp [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 16:52:06 devstack cinder-volume[86296]: WARNING amqp [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 16:52:06 devstack cinder-volume[86079]: INFO oslo_service.backend._eventlet.service [None req-f4bcb82d-8adb-4df3-83e6-ed3bc3450d30 None None] Child 86296 exited with status 0
Nov 03 16:52:07 devstack cinder-volume[86784]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 03 16:52:07 devstack cinder-volume[86784]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 16:52:07 devstack cinder-volume[86784]: we strongly recommend against using it for new projects.
Nov 03 16:52:07 devstack cinder-volume[86784]: If you are already using Eventlet, we recommend migrating to a different
Nov 03 16:52:07 devstack cinder-volume[86784]: framework.  For more detail see
Nov 03 16:52:07 devstack cinder-volume[86784]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 16:52:07 devstack cinder-volume[86784]:   import eventlet  # noqa
Nov 03 16:52:10 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:52:10 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:52:10 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:52:11 devstack cinder-volume[86784]: INFO dbcounter [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] Registered counter for database cinder
Nov 03 16:52:11 devstack cinder-volume[86784]: DEBUG oslo_db.sqlalchemy.engines [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86784) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:52:11 devstack cinder-volume[86784]: DEBUG dbcounter [-] [86784] Writer thread running {{(pid=86784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 16:52:11 devstack cinder-volume[86784]: INFO cinder.rpc [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 03 16:52:11 devstack cinder-volume[86784]: INFO cinder.rpc [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 03 16:52:11 devstack cinder-volume[86784]: DEBUG oslo_db.sqlalchemy.engines [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86784) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:52:12 devstack cinder-volume[86784]: INFO cinder.volume.manager [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] Determined volume DB was empty at startup.
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG cinder.volume.manager [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86784) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 03 16:52:12 devstack cinder-volume[86784]: WARNING stevedore.named [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 16:52:12 devstack cinder-volume[86784]: WARNING castellan.key_manager [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:52:12 devstack cinder-volume[86784]: WARNING cinder.keymgr.conf_key_mgr [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:52:12 devstack cinder-volume[86784]: INFO cinder.volume.manager [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_db.sqlalchemy.engines [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86784) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:52:12 devstack cinder-volume[86784]: INFO oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] Starting 1 workers
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] Started child 87122 {{(pid=86784) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] Full set of CONF: {{(pid=86784) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] ******************************************************************************** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] Configuration options gathered from: {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] ================================================================================ {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] allow_availability_zone_fallback = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] allow_compression_on_image_upload = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] allowed_direct_url_schemes     = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] api_rate_limit                 = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] auth_strategy                  = keystone {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_availability_zone      = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_host                   = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[87122]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_name                   = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_stats_polling_interval = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backup_api_class               = cinder.backup.api.API {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backup_name_template           = backup-%s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backup_use_same_host           = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backup_use_temp_snapshot       = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] chap_password                  = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] chap_username                  =  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cinder_internal_tenant_project_id = 3c21852b73aa48cf8122de1e221c378d {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cinder_internal_tenant_user_id = c72ec9929b2d442cad1530aefde130be {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cluster                        = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] compression_format             = gzip {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] compute_api_class              = cinder.compute.nova.API {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] config_dir                     = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] config_source                  = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] control_exchange               = openstack {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] debug                          = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] default_availability_zone      = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] default_group_type             = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] default_volume_type            = QuobyteHD {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] disk_geometry                  = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] driver_client_cert             = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] driver_client_cert_key         = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] driver_data_namespace          = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] driver_ssl_cert_path           = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] driver_ssl_cert_verify         = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] driver_use_ssl                 = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] enable_new_services            = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] enable_unsupported_driver      = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] enabled_backends               = ['QuobyteHD'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] enforce_multipath_for_image_xfer = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] filter_function                = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance_api_insecure            = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance_api_servers             = ['http://192.168.122.57/image'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance_api_ssl_compression     = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance_ca_certificates_file    = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance_catalog_info            = image:glance:publicURL {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance_certfile                = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance_keyfile                 = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance_num_retries             = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance_request_timeout         = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] goodness_function              = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] graceful_shutdown_timeout      = 5 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] group_api_class                = cinder.group.api.API {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87122) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] host                           = devstack {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] image_compress_on_upload       = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] image_conversion_address_space_limit = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] image_conversion_cpu_limit     = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] image_conversion_disable       = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] image_introspection_address_space_limit = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] image_introspection_cpu_limit  = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] image_upload_use_cinder_backend = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] image_upload_use_internal_tenant = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] image_volume_cache_enabled     = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] image_volume_cache_max_count   = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] image_volume_cache_max_size_gb = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] init_host_max_objects_retrieval = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] instance_format                = [instance: %(uuid)s]  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] iscsi_target_flags             =  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] iscsi_write_cache              = on {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] iser_helper                    = tgtadm {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] iser_ip_address                = 192.168.122.57 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] iser_port                      = 3260 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] log_color                      = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] log_config_append              = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] log_dir                        = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] log_file                       = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] log_options                    = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] log_rotate_interval            = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] log_rotate_interval_type       = days {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] log_rotation_type              = none {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] max_age                        = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] max_logfile_count              = 30 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] max_logfile_size_mb            = 200 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] max_over_subscription_ratio    = 20.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] message_reap_interval          = 86400 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] message_ttl                    = 2592000 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] migration_create_volume_timeout_secs = 300 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] monkey_patch                   = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] monkey_patch_modules           = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] my_ip                          = 192.168.122.57 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] no_snapshot_gb_quota           = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] num_iser_scan_tries            = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] num_shell_tries                = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] num_volume_device_scan_tries   = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] nvmeof_conn_info_version       = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87122) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 03 16:52:12 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.quobyte [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 03 16:52:12 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.quobyte [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] nvmet_ns_id                    = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] nvmet_port_id                  = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] osapi_max_limit                = 1000 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] osapi_volume_ext_list          = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Running cmd (subprocess): mount.quobyte {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] osapi_volume_listen_port       = 8776 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] osapi_volume_use_ssl           = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] osapi_volume_workers           = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] per_volume_size_limit          = -1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] periodic_fuzzy_delay           = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] periodic_interval              = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] public_endpoint                = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] publish_errors                 = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] quota_backup_gigabytes         = 1000 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] quota_backups                  = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] quota_gigabytes                = 1000 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] quota_groups                   = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] quota_snapshots                = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] quota_volumes                  = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] rate_limit_burst               = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] rate_limit_except_level        = CRITICAL {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] rate_limit_interval            = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] reinit_driver_count            = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] replication_device             = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] report_discard_supported       = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] report_interval                = 120 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] reservation_clean_interval     = 86400 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] reservation_expire             = 86400 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] reserved_image_namespaces      = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] reserved_percentage            = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] rpc_response_timeout           = 120 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] run_external_periodic_tasks    = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] scst_target_driver             = iscsi {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] scst_target_iqn_name           = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] service_down_time              = 720 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] shell_completion               = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] snapshot_name_template         = snapshot-%s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] split_loggers                  = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] state_path                     = /opt/stack/data/cinder {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] storage_availability_zone      = nova {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] storage_protocol               = iSCSI {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] syslog_log_facility            = LOG_USER {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] target_helper                  = lioadm {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] target_ip_address              = 192.168.122.57 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] target_port                    = 3260 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] target_protocol                = iscsi {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] target_secondary_ip_addresses  = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] trace_flags                    = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] transport_url                  = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] until_refresh                  = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] use_chap_auth                  = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] use_default_quota_class        = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] use_journal                    = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] use_json                       = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] use_multipath_for_image_xfer   = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] use_stderr                     = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] use_syslog                     = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] verify_glance_signatures       = enabled {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] volume_api_class               = cinder.volume.api.API {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] volume_backend_name            = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] volume_clear                   = zero {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] volume_clear_ionice            = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] volume_clear_size              = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] volume_copy_bps_limit          = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] volume_dd_blocksize            = 1M {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] volume_name_template           = volume-%s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] volume_service_inithost_offload = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] volume_usage_audit_period      = month {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] zoning_mode                    = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_concurrency.disable_process_locking = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack quobyte-client[87123]: Reading configuration file: /etc/quobyte/client.cfg
Nov 03 16:52:12 devstack quobyte-client[87123]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.auth_section = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.auth_type   = password {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.auth_version = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.cache       = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.certfile    = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.include_service_catalog = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.insecure    = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.interface   = public {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.keyfile     = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_password = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcache_username = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.region_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.service_type = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.57/identity {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.backend                  = dogpile.cache.null {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.backend_argument         = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.backend_expiration_time  = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.config_prefix            = cache.oslo {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.debug_cache_backend      = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.enable_retry_client      = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.enable_socket_keepalive  = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.enabled                  = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.expiration_time          = 600 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.hashclient_retry_attempts = 2 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.memcache_dead_retry      = 300 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.memcache_pool_maxsize    = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.memcache_sasl_enabled    = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.password                 = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.proxies                  = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.redis_db                 = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.redis_server             = localhost:6379 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.retry_attempts           = 2 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.retry_delay              = 0.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.socket_keepalive_count   = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.socket_keepalive_idle    = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.socket_keepalive_interval = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.socket_timeout           = 1.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.tls_allowed_ciphers      = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.tls_cafile               = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.tls_certfile             = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.tls_enabled              = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.tls_keyfile              = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cache.username                 = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] coordination.backend_url       = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.asyncio_connection    = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.asyncio_slave_connection = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.backend               = sqlalchemy {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.connection            = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.connection_debug      = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.connection_parameters =  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.connection_recycle_time = 3600 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.connection_trace      = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.db_inc_retry_interval = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.db_max_retries        = 20 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.db_max_retry_interval = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.db_retry_interval     = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.max_overflow          = 50 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.max_pool_size         = 5 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.max_retries           = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.mysql_wsrep_sync_wait = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.pool_timeout          = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.retry_interval        = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.slave_connection      = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.sqlite_synchronous    = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.synchronous_reader    = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] database.use_db_reconnect      = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_tracing.insecure = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler.connection_string     = messaging:// {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler.enabled               = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler.es_doc_type           = notification {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler.es_scroll_size        = 10000 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler.es_scroll_time        = 2m {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler.filter_error_trace    = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler.hmac_keys             = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler.sentinel_service_name = mymaster {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler.socket_timeout        = 0.1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler.trace_requests        = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler.trace_sqlalchemy      = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler_jaeger.process_tags   = {} {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler_jaeger.service_name_prefix = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] profiler_otlp.service_name_prefix = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_policy.enforce_new_defaults = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_policy.policy_default_rule = default {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_policy.policy_file        = policy.yaml {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack sudo[87124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] privsep_osbrick.group          = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] privsep_osbrick.helper_command = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] privsep_osbrick.user           = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cinder_sys_admin.group         = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cinder_sys_admin.helper_command = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] cinder_sys_admin.user          = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] service_user.auth_section      = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] service_user.auth_type         = password {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] service_user.cafile            = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] service_user.certfile          = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] service_user.collect_timing    = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] service_user.insecure          = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] service_user.keyfile           = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] service_user.send_service_user_token = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] service_user.split_loggers     = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] service_user.timeout           = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] service_user.tls_ciphers       = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] service_user.tls_min_version   = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance.auth_section            = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance.auth_type               = password {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance.certfile                = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance.collect_timing          = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance.insecure                = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance.keyfile                 = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance.region_name             = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance.split_loggers           = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance.timeout                 = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance.tls_ciphers             = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] glance.tls_min_version         = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.backend_availability_zone = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.chap_password = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.chap_username =  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.disk_geometry = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.driver_client_cert = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.driver_client_cert_key = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.driver_data_namespace = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.driver_use_ssl = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.extra_capabilities = {} {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.filter_function = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.goodness_function = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.iscsi_target_flags =  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.iscsi_write_cache = on {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.iser_helper   = tgtadm {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.iser_ip_address = 192.168.122.57 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.iser_port     = 3260 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.nas_host      =  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.nas_login     = admin {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.nas_mount_options = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.nas_password  = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.nas_private_key =  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.nas_share_path =  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.num_shell_tries = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.quobyte_volume_url = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.replication_device = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.report_discard_supported = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.reserved_percentage = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.target_helper = tgtadm {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.target_ip_address = 192.168.122.57 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.target_port   = 3260 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.target_protocol = iscsi {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.trace_flags   = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.unique_fqdn_network = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.use_chap_auth = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.volume_backend_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.volume_clear  = zero {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.volume_clear_ionice = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.volume_clear_size = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_reports.file_event_handler = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_reports.log_dir           = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.backend_availability_zone = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.backend_host         = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.chap_password        = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.chap_username        = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.chiscsi_conf         = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.disk_geometry        = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.driver_client_cert   = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.driver_data_namespace = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.driver_use_ssl       = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.extra_capabilities   = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.filter_function      = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.goodness_function    = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.iser_helper          = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.iser_ip_address      = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.iser_port            = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.iser_target_prefix   = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.nas_host             = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.nas_login            = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.nas_mount_options    = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.nas_password         = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.nas_private_key      = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.nas_share_path       = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.nas_ssh_port         = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.num_shell_tries      = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.nvmet_port_id        = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.replication_device   = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.report_discard_supported = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.reserved_percentage  = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.scst_target_driver   = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.storage_protocol     = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.target_helper        = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.target_ip_address    = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.target_port          = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.target_prefix        = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.target_protocol      = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.trace_flags          = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.use_chap_auth        = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.volume_clear         = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.volume_clear_size    = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] QuobyteHD.volumes_dir          = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.ssl      = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_notifications.driver = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_notifications.retry = -1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] key_manager.fixed_key          = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.barbican_api_version  = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.barbican_endpoint     = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.barbican_endpoint_type = public {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.barbican_region_name  = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.cafile                = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.certfile              = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.collect_timing        = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.insecure              = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.keyfile               = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.number_of_retries     = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.retry_delay           = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.send_service_user_token = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.split_loggers         = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.timeout               = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.tls_ciphers           = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.tls_min_version       = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.verify_ssl            = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican.verify_ssl_path       = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican_service_user.auth_section = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican_service_user.auth_type = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican_service_user.cafile   = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican_service_user.certfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican_service_user.collect_timing = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican_service_user.insecure = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican_service_user.keyfile  = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican_service_user.split_loggers = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican_service_user.timeout  = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican_service_user.tls_ciphers = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] barbican_service_user.tls_min_version = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.approle_role_id          = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.approle_secret_id        = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.auth_method              = approle {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.auth_path                = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.kv_mountpoint            = secret {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.kv_path                  = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.kv_version               = 2 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.namespace                = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.root_token_id            = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.ssl_ca_crt_file          = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.timeout                  = 60.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.token_file               = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.token_role               = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.use_ssl                  = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:52:12 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-a986a111-140c-45ea-8aa2-b3c7caa7280a None None] ******************************************************************************** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 03 16:52:12 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.361s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:52:12 devstack cinder-volume[87122]: INFO cinder.volume.driver [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Driver hasn't implemented _init_vendor_properties()
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG cinder.volume.driver [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7029113769531, 'free_capacity_gb': 1773.7029113769531, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87122) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG oslo_db.sqlalchemy.engines [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writer thread running {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG cinder.db.api [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Building query based on filter {{(pid=87122) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87122) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:52:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:52:12 devstack cinder-volume[87122]: INFO cinder.keymgr.migration [None req-dafe6e40-670d-43c1-925f-4ae6cc5d7e0b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 03 16:52:12 devstack sudo[87134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:52:12 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:52:13 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root
Nov 03 16:52:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:52:13 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:52:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Driver initialization completed successfully.
Nov 03 16:52:13 devstack cinder-volume[87122]: INFO cinder.manager [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Initiating service 3 cleanup
Nov 03 16:52:13 devstack cinder-volume[87122]: INFO cinder.manager [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Service 3 cleanup completed.
Nov 03 16:52:13 devstack cinder-volume[87122]: DEBUG cinder.service [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Creating RPC server for service cinder-volume {{(pid=87122) start /opt/stack/cinder/cinder/service.py:231}}
Nov 03 16:52:13 devstack cinder-volume[87122]: DEBUG cinder.service [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87122) start /opt/stack/cinder/cinder/service.py:237}}
Nov 03 16:52:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 03 16:52:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:52:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:52:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:52:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:52:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:52:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:52:13 devstack sudo[87141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:52:13 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:52:13 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root
Nov 03 16:52:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.318s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:52:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2bb5313a-9f6f-4af2-9b9e-72ace4fca7bf None None] Driver post RPC initialization completed successfully.
Nov 03 16:52:22 devstack cinder-volume[86784]: DEBUG dbcounter [-] [86784] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:52:22 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:52:23 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:52:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:52:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 6 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:52:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Flow 'volume_create_manager' (7feb0a7c-6ac9-42fa-adbe-3a0a056af185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30b8fd4-3ece-40fb-9c92-b616bedc3789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30b8fd4-3ece-40fb-9c92-b616bedc3789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-870127644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65992749-13bb-4625-afc9-d960dbf1e782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68561dbb510f45feaa7e70d547e168ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:53:32Z,use_quota=True,user_id='e6a1f70bb0474727b56e4d9769288083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418ddf2f-bb79-4112-8a77-ba9524758e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418ddf2f-bb79-4112-8a77-ba9524758e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4be79e-8cbb-4bc1-94a2-1ab1e5d23cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4be79e-8cbb-4bc1-94a2-1ab1e5d23cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65992749-13bb-4625-afc9-d960dbf1e782', 'volume_name': 'volume-65992749-13bb-4625-afc9-d960dbf1e782', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c59dc1d-1c64-413c-99bf-0d19f2834a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c59dc1d-1c64-413c-99bf-0d19f2834a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3185db3-47e2-4975-b98e-38afb8d6b6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:32 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Volume 65992749-13bb-4625-afc9-d960dbf1e782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65992749-13bb-4625-afc9-d960dbf1e782', 'volume_size': 1}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-870127644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65992749-13bb-4625-afc9-d960dbf1e782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68561dbb510f45feaa7e70d547e168ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:53:32Z,use_quota=True,user_id='e6a1f70bb0474727b56e4d9769288083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Creating volume 65992749-13bb-4625-afc9-d960dbf1e782 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:53:32 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:53:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-65992749-13bb-4625-afc9-d960dbf1e782 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:53:32 devstack sudo[87732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-65992749-13bb-4625-afc9-d960dbf1e782 1073741824
Nov 03 16:53:32 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:53:34 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root
Nov 03 16:53:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-65992749-13bb-4625-afc9-d960dbf1e782 1073741824" returned: 0 in 1.978s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:53:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-65992749-13bb-4625-afc9-d960dbf1e782 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:53:35 devstack sudo[88082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-65992749-13bb-4625-afc9-d960dbf1e782
Nov 03 16:53:35 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:53:35 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root
Nov 03 16:53:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-65992749-13bb-4625-afc9-d960dbf1e782" returned: 0 in 0.713s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:53:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] <== create_volume: return (2897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:53:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.910s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:53:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3185db3-47e2-4975-b98e-38afb8d6b6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65992749-13bb-4625-afc9-d960dbf1e782', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1686b3e6-4896-48b5-b0b0-518fce12f99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:35 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Volume volume-65992749-13bb-4625-afc9-d960dbf1e782 (65992749-13bb-4625-afc9-d960dbf1e782): created successfully
Nov 03 16:53:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1686b3e6-4896-48b5-b0b0-518fce12f99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Flow 'volume_create_manager' (7feb0a7c-6ac9-42fa-adbe-3a0a056af185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:53:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7f628fc8-f87b-47b0-b7b8-183675124650 tempest-DeleteServersTestJSON-2144225597 None] Created volume successfully.
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Flow 'volume_create_manager' (47f26100-c3d6-4526-9cdc-932edc0f05d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d7e6e8-996b-44de-89b8-bb9744ac77fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d7e6e8-996b-44de-89b8-bb9744ac77fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-943129748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de994f11-871d-412e-89ff-15dcdc38a922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58db27e36c394331aa89162fb8b2e541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:53:40Z,use_quota=True,user_id='50924675455549c9bf267f80732e8e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac186746-f539-473b-ac1b-014192453550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac186746-f539-473b-ac1b-014192453550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6bcbdac-df6c-4074-b039-d5aafa7228c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6bcbdac-df6c-4074-b039-d5aafa7228c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de994f11-871d-412e-89ff-15dcdc38a922', 'volume_name': 'volume-de994f11-871d-412e-89ff-15dcdc38a922', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07714a93-5c44-4159-8175-ae4079489fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07714a93-5c44-4159-8175-ae4079489fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312cfcbd-48ae-416b-9b6b-4b0845166a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Volume de994f11-871d-412e-89ff-15dcdc38a922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de994f11-871d-412e-89ff-15dcdc38a922', 'volume_size': 1}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-943129748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de994f11-871d-412e-89ff-15dcdc38a922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58db27e36c394331aa89162fb8b2e541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:53:40Z,use_quota=True,user_id='50924675455549c9bf267f80732e8e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Creating volume de994f11-871d-412e-89ff-15dcdc38a922 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:53:40 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:53:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-de994f11-871d-412e-89ff-15dcdc38a922 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:53:40 devstack sudo[88097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-de994f11-871d-412e-89ff-15dcdc38a922 1073741824
Nov 03 16:53:40 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:53:41 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root
Nov 03 16:53:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-de994f11-871d-412e-89ff-15dcdc38a922 1073741824" returned: 0 in 1.599s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:53:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-de994f11-871d-412e-89ff-15dcdc38a922 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:53:41 devstack sudo[88144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-de994f11-871d-412e-89ff-15dcdc38a922
Nov 03 16:53:41 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:53:42 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root
Nov 03 16:53:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-de994f11-871d-412e-89ff-15dcdc38a922" returned: 0 in 0.807s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:53:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] <== create_volume: return (2543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:53:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.547s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:53:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312cfcbd-48ae-416b-9b6b-4b0845166a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de994f11-871d-412e-89ff-15dcdc38a922', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87daa35d-5f57-4c95-9e63-8a6a8774aee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Volume volume-de994f11-871d-412e-89ff-15dcdc38a922 (de994f11-871d-412e-89ff-15dcdc38a922): created successfully
Nov 03 16:53:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87daa35d-5f57-4c95-9e63-8a6a8774aee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Flow 'volume_create_manager' (47f26100-c3d6-4526-9cdc-932edc0f05d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:53:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-65e1e07e-3985-42a2-a55d-781fe5f335f5 tempest-VolumesAdminNegativeTest-1556309863 None] Created volume successfully.
Nov 03 16:53:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Acquiring lock "cinder-de994f11-871d-412e-89ff-15dcdc38a922-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:53:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Lock "cinder-de994f11-871d-412e-89ff-15dcdc38a922-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:53:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Acquiring lock "cinder-quobyte-de994f11-871d-412e-89ff-15dcdc38a922" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:53:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Lock "cinder-quobyte-de994f11-871d-412e-89ff-15dcdc38a922" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:53:45 devstack cinder-volume[87122]: INFO oslo.privsep.daemon [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnon9dj_i/privsep.sock']
Nov 03 16:53:45 devstack sudo[88182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnon9dj_i/privsep.sock
Nov 03 16:53:45 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:53:47 devstack cinder-volume[87122]: WARNING py.warnings [req-570a2271-c64c-4fb2-be38-d7b14cda42cf req-72f54922-3c79-4bea-b1d1-4b0c048d560d tempest-DeleteServersTestJSON-2144225597 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Nov 03 16:53:47 devstack cinder-volume[87122]:   .first()
Nov 03 16:53:47 devstack cinder-volume[87122]: 
Nov 03 16:53:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-570a2271-c64c-4fb2-be38-d7b14cda42cf req-72f54922-3c79-4bea-b1d1-4b0c048d560d tempest-DeleteServersTestJSON-2144225597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:53:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-570a2271-c64c-4fb2-be38-d7b14cda42cf req-72f54922-3c79-4bea-b1d1-4b0c048d560d tempest-DeleteServersTestJSON-2144225597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:53:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-570a2271-c64c-4fb2-be38-d7b14cda42cf req-72f54922-3c79-4bea-b1d1-4b0c048d560d tempest-DeleteServersTestJSON-2144225597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:53:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-570a2271-c64c-4fb2-be38-d7b14cda42cf req-72f54922-3c79-4bea-b1d1-4b0c048d560d tempest-DeleteServersTestJSON-2144225597 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-65992749-13bb-4625-afc9-d960dbf1e782', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29181283-b442-4afc-b24c-fa88dfcc3fab', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:53:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-570a2271-c64c-4fb2-be38-d7b14cda42cf req-72f54922-3c79-4bea-b1d1-4b0c048d560d tempest-DeleteServersTestJSON-2144225597 None] attachment_update completed successfully.
Nov 03 16:53:47 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 03 16:53:47 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 16:53:47 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 03 16:53:47 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 03 16:53:47 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 03 16:53:47 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 03 16:53:47 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 16:53:47 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 03 16:53:47 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 03 16:53:48 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root
Nov 03 16:53:48 devstack cinder-volume[87122]: INFO oslo.privsep.daemon [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Spawned new privsep daemon via rootwrap
Nov 03 16:53:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Accepted privsep connection to /tmp/tmpnon9dj_i/privsep.sock {{(pid=87122) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 03 16:53:48 devstack cinder-volume[87122]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 16:53:48 devstack cinder-volume[87122]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 16:53:48 devstack cinder-volume[87122]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 03 16:53:48 devstack cinder-volume[87122]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88206
Nov 03 16:53:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc782d7-de3a-4216-8b1e-b703928fa3c7]: (2,) {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:53:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0482a773-a659-4965-8b28-61365e333053]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:53:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-de994f11-871d-412e-89ff-15dcdc38a922 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:53:48 devstack sudo[88223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-de994f11-871d-412e-89ff-15dcdc38a922
Nov 03 16:53:48 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:53:49 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root
Nov 03 16:53:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-de994f11-871d-412e-89ff-15dcdc38a922" returned: 0 in 1.170s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:53:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-de994f11-871d-412e-89ff-15dcdc38a922 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:53:49 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-de994f11-871d-412e-89ff-15dcdc38a922
Nov 03 16:53:49 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:53:50 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Nov 03 16:53:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-de994f11-871d-412e-89ff-15dcdc38a922" returned: 0 in 0.634s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:53:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Lock "cinder-quobyte-de994f11-871d-412e-89ff-15dcdc38a922" released by "delete_volume" :: held 5.028s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:53:50 devstack cinder-volume[87122]: WARNING cinder.quota [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:53:50 devstack cinder-volume[87122]: WARNING cinder.quota [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:53:50 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Created reservations ['1fbadc44-bfba-45e0-a45f-3e5bc7f6ed49', '9b2909b2-011d-4c6f-8924-ccd77cae7844', 'f54b39de-0d1f-4f7b-adc4-635342e211eb', '3d55aa17-97b1-494a-a71c-69224f9f5da0'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:53:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:53:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:53:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:53:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:53:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:53:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:53:50 devstack sudo[88685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:53:50 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:53:51 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root
Nov 03 16:53:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.605s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:53:51 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:53:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Deleted volume successfully.
Nov 03 16:53:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d8e17bf-7fae-4e71-94b1-192f9dd6244e tempest-VolumesAdminNegativeTest-1556309863 None] Lock "cinder-de994f11-871d-412e-89ff-15dcdc38a922-delete_volume" released by "delete_volume" :: held 6.421s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:53:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:53:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:53:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:53:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:53:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:53:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:53:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:53:51 devstack sudo[88691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:53:51 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:53:52 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root
Nov 03 16:53:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.391s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:53:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:53:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:53:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 8 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:53:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:53:56 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-440f2dfc-5394-42c4-9cd6-be7262d421b6 req-2feb4ba1-c288-4491-8c11-1535cc0c49d8 tempest-DeleteServersTestJSON-2144225597 None] Terminate volume connection completed successfully.
Nov 03 16:53:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-440f2dfc-5394-42c4-9cd6-be7262d421b6 req-2feb4ba1-c288-4491-8c11-1535cc0c49d8 tempest-DeleteServersTestJSON-2144225597 None] Deleting attachment 29181283-b442-4afc-b24c-fa88dfcc3fab. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Flow 'volume_create_manager' (a94de1b0-7ac6-4860-bbcf-dda045b13dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a1b4d9-575b-4840-98a6-b1fda73468dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a1b4d9-575b-4840-98a6-b1fda73468dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-858000600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8241d06-f297-43d0-9b12-b54ed54a188a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d18d0b8c434730b9fa22a69a366755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:53:57Z,use_quota=True,user_id='44681e1b718b4cb9b66952223c019064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacd1613-b4c0-4769-ba08-d95a8ecd838c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacd1613-b4c0-4769-ba08-d95a8ecd838c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d09044c-4a06-42be-80e4-2501a86705c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d09044c-4a06-42be-80e4-2501a86705c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8241d06-f297-43d0-9b12-b54ed54a188a', 'volume_name': 'volume-c8241d06-f297-43d0-9b12-b54ed54a188a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50db44e0-cc11-4273-b467-2981b91a9638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50db44e0-cc11-4273-b467-2981b91a9638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afcf45e-252d-4a15-96ca-12c7485d50a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:57 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Volume c8241d06-f297-43d0-9b12-b54ed54a188a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8241d06-f297-43d0-9b12-b54ed54a188a', 'volume_size': 1}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-858000600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8241d06-f297-43d0-9b12-b54ed54a188a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d18d0b8c434730b9fa22a69a366755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:53:57Z,use_quota=True,user_id='44681e1b718b4cb9b66952223c019064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Creating volume c8241d06-f297-43d0-9b12-b54ed54a188a {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:53:57 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8241d06-f297-43d0-9b12-b54ed54a188a 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:53:57 devstack sudo[88771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8241d06-f297-43d0-9b12-b54ed54a188a 1073741824
Nov 03 16:53:57 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:53:57 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8241d06-f297-43d0-9b12-b54ed54a188a 1073741824" returned: 0 in 0.502s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:53:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8241d06-f297-43d0-9b12-b54ed54a188a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:53:57 devstack sudo[88778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8241d06-f297-43d0-9b12-b54ed54a188a
Nov 03 16:53:57 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:53:58 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root
Nov 03 16:53:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8241d06-f297-43d0-9b12-b54ed54a188a" returned: 0 in 0.335s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:53:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:53:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:53:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afcf45e-252d-4a15-96ca-12c7485d50a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8241d06-f297-43d0-9b12-b54ed54a188a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb2eac9-770f-4a46-945c-08fd6e384d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:53:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Volume volume-c8241d06-f297-43d0-9b12-b54ed54a188a (c8241d06-f297-43d0-9b12-b54ed54a188a): created successfully
Nov 03 16:53:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb2eac9-770f-4a46-945c-08fd6e384d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:53:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Flow 'volume_create_manager' (a94de1b0-7ac6-4860-bbcf-dda045b13dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:53:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-caf7e9e0-c519-4dff-88c1-fb1f7220c8a8 tempest-ServersNegativeTestJSON-1695328884 None] Created volume successfully.
Nov 03 16:53:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Acquiring lock "cinder-65992749-13bb-4625-afc9-d960dbf1e782-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:53:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Lock "cinder-65992749-13bb-4625-afc9-d960dbf1e782-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:53:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Acquiring lock "cinder-quobyte-65992749-13bb-4625-afc9-d960dbf1e782" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:53:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Lock "cinder-quobyte-65992749-13bb-4625-afc9-d960dbf1e782" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:53:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[720ed205-7907-4563-906f-3301d37cedb1]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:53:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-65992749-13bb-4625-afc9-d960dbf1e782 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:53:59 devstack sudo[88783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-65992749-13bb-4625-afc9-d960dbf1e782
Nov 03 16:53:59 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:00 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-65992749-13bb-4625-afc9-d960dbf1e782" returned: 0 in 0.453s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-65992749-13bb-4625-afc9-d960dbf1e782 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:00 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-65992749-13bb-4625-afc9-d960dbf1e782
Nov 03 16:54:00 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:00 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-65992749-13bb-4625-afc9-d960dbf1e782" returned: 0 in 0.281s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Lock "cinder-quobyte-65992749-13bb-4625-afc9-d960dbf1e782" released by "delete_volume" :: held 0.799s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:54:00 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Created reservations ['99eff0d3-e2c6-4e11-8e96-ca5054f38cdd', '81aa1719-0bbb-47ec-aa77-062a06f1c8f8', '32897faa-3dbd-4ae0-b0a7-cf0bf260b7e3', 'b3d2e6e3-d11b-4b55-9dbf-acbf8fb66cf3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:54:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:54:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:54:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:00 devstack sudo[88791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:54:00 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:01 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.541s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:54:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Deleted volume successfully.
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-73f82592-afc9-407e-bc5d-e5489df6eead tempest-DeleteServersTestJSON-2144225597 None] Lock "cinder-65992749-13bb-4625-afc9-d960dbf1e782-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Flow 'volume_create_manager' (db8c4710-3529-4d72-a0e6-268b8a1e5556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9567b8f3-b6a6-4571-bec5-329e22fd2231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9567b8f3-b6a6-4571-bec5-329e22fd2231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1965743578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d67556f-d1e2-41fc-a5c1-04f82759804e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d18d0b8c434730b9fa22a69a366755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:02Z,use_quota=True,user_id='44681e1b718b4cb9b66952223c019064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dd7209-f583-4f49-9fde-a3d8d7113b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dd7209-f583-4f49-9fde-a3d8d7113b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86eb63e-670a-4ea6-9e56-f1425a27364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86eb63e-670a-4ea6-9e56-f1425a27364d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d67556f-d1e2-41fc-a5c1-04f82759804e', 'volume_name': 'volume-2d67556f-d1e2-41fc-a5c1-04f82759804e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc27743d-442a-4553-a916-f7bde7899f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc27743d-442a-4553-a916-f7bde7899f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7d2e3b-aae8-4245-920f-a40cbc45d821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:01 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Volume 2d67556f-d1e2-41fc-a5c1-04f82759804e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d67556f-d1e2-41fc-a5c1-04f82759804e', 'volume_size': 1}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1965743578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d67556f-d1e2-41fc-a5c1-04f82759804e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d18d0b8c434730b9fa22a69a366755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:02Z,use_quota=True,user_id='44681e1b718b4cb9b66952223c019064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Creating volume 2d67556f-d1e2-41fc-a5c1-04f82759804e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:54:01 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:54:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2d67556f-d1e2-41fc-a5c1-04f82759804e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:01 devstack sudo[88830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2d67556f-d1e2-41fc-a5c1-04f82759804e 1073741824
Nov 03 16:54:01 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:02 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2d67556f-d1e2-41fc-a5c1-04f82759804e 1073741824" returned: 0 in 0.566s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2d67556f-d1e2-41fc-a5c1-04f82759804e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:02 devstack sudo[88836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2d67556f-d1e2-41fc-a5c1-04f82759804e
Nov 03 16:54:02 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:02 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2d67556f-d1e2-41fc-a5c1-04f82759804e" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:54:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7d2e3b-aae8-4245-920f-a40cbc45d821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d67556f-d1e2-41fc-a5c1-04f82759804e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ba2274-31b3-4dc7-ad57-dd3ec6a03caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:02 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Volume volume-2d67556f-d1e2-41fc-a5c1-04f82759804e (2d67556f-d1e2-41fc-a5c1-04f82759804e): created successfully
Nov 03 16:54:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ba2274-31b3-4dc7-ad57-dd3ec6a03caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Flow 'volume_create_manager' (db8c4710-3529-4d72-a0e6-268b8a1e5556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:54:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2249982f-744f-459a-8b5a-0e0f6cd44ae9 tempest-ServersNegativeTestJSON-1695328884 None] Created volume successfully.
Nov 03 16:54:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Acquiring lock "cinder-2d67556f-d1e2-41fc-a5c1-04f82759804e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:54:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Lock "cinder-2d67556f-d1e2-41fc-a5c1-04f82759804e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:54:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Acquiring lock "cinder-quobyte-2d67556f-d1e2-41fc-a5c1-04f82759804e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:54:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Lock "cinder-quobyte-2d67556f-d1e2-41fc-a5c1-04f82759804e" acquired by "delete_volume" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:54:07 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[febc2c67-eab1-4588-8c33-b33fefd3f0bc]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:54:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2d67556f-d1e2-41fc-a5c1-04f82759804e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:07 devstack sudo[88845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2d67556f-d1e2-41fc-a5c1-04f82759804e
Nov 03 16:54:07 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:08 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2d67556f-d1e2-41fc-a5c1-04f82759804e" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2d67556f-d1e2-41fc-a5c1-04f82759804e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:08 devstack sudo[88851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2d67556f-d1e2-41fc-a5c1-04f82759804e
Nov 03 16:54:08 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:08 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2d67556f-d1e2-41fc-a5c1-04f82759804e" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Lock "cinder-quobyte-2d67556f-d1e2-41fc-a5c1-04f82759804e" released by "delete_volume" :: held 0.779s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Created reservations ['ed142625-26b8-4b5b-93da-73c412624da8', '25fc2d06-b995-4597-bddf-ab95bb6d838c', '19394e1f-ff2a-4ce3-be1e-aaade794afb8', 'd26dd291-6735-4a0a-9e78-c40ad1570f72'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:08 devstack sudo[88860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:54:08 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Acquiring lock "cinder-c8241d06-f297-43d0-9b12-b54ed54a188a-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Lock "cinder-c8241d06-f297-43d0-9b12-b54ed54a188a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Acquiring lock "cinder-quobyte-c8241d06-f297-43d0-9b12-b54ed54a188a" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:54:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Lock "cinder-quobyte-c8241d06-f297-43d0-9b12-b54ed54a188a" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:54:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed31cf4-0ac0-401d-80cf-bbac6fd2331f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:54:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8241d06-f297-43d0-9b12-b54ed54a188a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:09 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.463s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:09 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:54:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Deleted volume successfully.
Nov 03 16:54:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-44f7c901-c963-4742-bf74-6df586ccd332 tempest-ServersNegativeTestJSON-1695328884 None] Lock "cinder-2d67556f-d1e2-41fc-a5c1-04f82759804e-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:54:09 devstack sudo[88866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8241d06-f297-43d0-9b12-b54ed54a188a
Nov 03 16:54:09 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:09 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8241d06-f297-43d0-9b12-b54ed54a188a" returned: 0 in 0.526s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8241d06-f297-43d0-9b12-b54ed54a188a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:09 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8241d06-f297-43d0-9b12-b54ed54a188a
Nov 03 16:54:09 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:09 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8241d06-f297-43d0-9b12-b54ed54a188a" returned: 0 in 0.311s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Lock "cinder-quobyte-c8241d06-f297-43d0-9b12-b54ed54a188a" released by "delete_volume" :: held 0.915s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:54:09 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Created reservations ['593d516c-e2b9-42b1-834f-3c5ba5716426', '86000391-20ca-441d-afcb-78bb15bb602c', 'f2cd6f63-8034-4fa9-8dab-de70aacd5649', '03b85a71-ad41-4ed3-9ea3-2d7ac8010e5c'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:54:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:54:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:54:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:10 devstack sudo[88885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:54:10 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:10 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.298s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:10 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:54:10 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Deleted volume successfully.
Nov 03 16:54:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9197f6b3-b8c2-4f33-874c-314c989c42e8 tempest-ServersNegativeTestJSON-1695328884 None] Lock "cinder-c8241d06-f297-43d0-9b12-b54ed54a188a-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:54:23 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=32,cinder:UPDATE=52,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:54:23 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=40,cinder:UPDATE=40,cinder:INSERT=6,cinder:DELETE=4 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Flow 'volume_create_manager' (1c76918a-970c-40e3-95b9-d33b19d05ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bedb14c1-432e-44f1-a0a5-17563c294df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bedb14c1-432e-44f1-a0a5-17563c294df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2108284847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62659714-4863-4a33-aa23-c6f4f20cccf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161cc0f473ea4b698aa8c40ba6513682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:35Z,use_quota=True,user_id='7eb76800dfd6463bba595beff7ce8993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d04b6e-67c9-4f1c-a97c-835cb36a0daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d04b6e-67c9-4f1c-a97c-835cb36a0daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a948d947-5692-4e47-b274-2b8ecb6c93b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a948d947-5692-4e47-b274-2b8ecb6c93b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62659714-4863-4a33-aa23-c6f4f20cccf5', 'volume_name': 'volume-62659714-4863-4a33-aa23-c6f4f20cccf5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e9d3f3-abc2-4dfe-8b50-91ed11850a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e9d3f3-abc2-4dfe-8b50-91ed11850a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902120b7-b105-48b8-9d31-842bb74b52a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:34 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Volume 62659714-4863-4a33-aa23-c6f4f20cccf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62659714-4863-4a33-aa23-c6f4f20cccf5', 'volume_size': 1}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2108284847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62659714-4863-4a33-aa23-c6f4f20cccf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161cc0f473ea4b698aa8c40ba6513682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:35Z,use_quota=True,user_id='7eb76800dfd6463bba595beff7ce8993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Creating volume 62659714-4863-4a33-aa23-c6f4f20cccf5 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:54:34 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:54:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62659714-4863-4a33-aa23-c6f4f20cccf5 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:34 devstack sudo[88927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62659714-4863-4a33-aa23-c6f4f20cccf5 1073741824
Nov 03 16:54:34 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:35 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62659714-4863-4a33-aa23-c6f4f20cccf5 1073741824" returned: 0 in 0.516s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62659714-4863-4a33-aa23-c6f4f20cccf5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:35 devstack sudo[88934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62659714-4863-4a33-aa23-c6f4f20cccf5
Nov 03 16:54:35 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:35 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62659714-4863-4a33-aa23-c6f4f20cccf5" returned: 0 in 0.413s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:54:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902120b7-b105-48b8-9d31-842bb74b52a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62659714-4863-4a33-aa23-c6f4f20cccf5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8e5abe-7525-4465-a228-4bb4562e6369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:35 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Volume volume-62659714-4863-4a33-aa23-c6f4f20cccf5 (62659714-4863-4a33-aa23-c6f4f20cccf5): created successfully
Nov 03 16:54:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8e5abe-7525-4465-a228-4bb4562e6369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Flow 'volume_create_manager' (1c76918a-970c-40e3-95b9-d33b19d05ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:54:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a3d975dc-3e4d-426a-94d1-0d8ab8d79f1a tempest-VolumesTestJSON-2079105828 None] Created volume successfully.
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Flow 'volume_create_manager' (442e1e4e-04cc-4668-80bf-2b0c86b9d6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6932c34c-dcbd-4624-8183-b39758a0ec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6932c34c-dcbd-4624-8183-b39758a0ec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1417262929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eafa427-2ef1-4547-be6f-95db88a9097d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da74cd8df7c648f29170a9c0a65c4084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:36Z,use_quota=True,user_id='67d009105d744d739d6a9c584c5699a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655c6014-c801-440a-852f-a64cce91d588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655c6014-c801-440a-852f-a64cce91d588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf39ee4-a234-4263-9513-ea689612286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf39ee4-a234-4263-9513-ea689612286f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eafa427-2ef1-4547-be6f-95db88a9097d', 'volume_name': 'volume-0eafa427-2ef1-4547-be6f-95db88a9097d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd2f550-02e7-45da-a9e8-831f20d9eb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd2f550-02e7-45da-a9e8-831f20d9eb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ddd37d4-020c-44cc-89ca-570afe889556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:36 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Volume 0eafa427-2ef1-4547-be6f-95db88a9097d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eafa427-2ef1-4547-be6f-95db88a9097d', 'volume_size': 1}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1417262929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eafa427-2ef1-4547-be6f-95db88a9097d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da74cd8df7c648f29170a9c0a65c4084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:36Z,use_quota=True,user_id='67d009105d744d739d6a9c584c5699a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Creating volume 0eafa427-2ef1-4547-be6f-95db88a9097d {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:54:36 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0eafa427-2ef1-4547-be6f-95db88a9097d 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:36 devstack sudo[88937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0eafa427-2ef1-4547-be6f-95db88a9097d 1073741824
Nov 03 16:54:36 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:36 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0eafa427-2ef1-4547-be6f-95db88a9097d 1073741824" returned: 0 in 0.488s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0eafa427-2ef1-4547-be6f-95db88a9097d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:36 devstack sudo[88943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0eafa427-2ef1-4547-be6f-95db88a9097d
Nov 03 16:54:36 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:36 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0eafa427-2ef1-4547-be6f-95db88a9097d" returned: 0 in 0.315s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ddd37d4-020c-44cc-89ca-570afe889556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eafa427-2ef1-4547-be6f-95db88a9097d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305b9065-c7cc-4961-8634-536e0654ba68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:37 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Volume volume-0eafa427-2ef1-4547-be6f-95db88a9097d (0eafa427-2ef1-4547-be6f-95db88a9097d): created successfully
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305b9065-c7cc-4961-8634-536e0654ba68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Flow 'volume_create_manager' (442e1e4e-04cc-4668-80bf-2b0c86b9d6c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:54:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1336a11c-02f6-4a2c-87fb-98e7f303a745 tempest-TaggedAttachmentsTest-1603948028 None] Created volume successfully.
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Flow 'volume_create_manager' (c0497855-2e6e-414e-867f-6678cbf16a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3de1d7-4e6c-4c5b-ae29-9c32e8a86e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3de1d7-4e6c-4c5b-ae29-9c32e8a86e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1080145685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb2713a-933d-4abe-8240-f09794d2ec50,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161cc0f473ea4b698aa8c40ba6513682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:38Z,use_quota=True,user_id='7eb76800dfd6463bba595beff7ce8993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a06d62-3893-46e8-b04e-1f7e95505c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a06d62-3893-46e8-b04e-1f7e95505c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b0a506-843a-4a38-bbb2-966267fd0aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b0a506-843a-4a38-bbb2-966267fd0aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb2713a-933d-4abe-8240-f09794d2ec50', 'volume_name': 'volume-7eb2713a-933d-4abe-8240-f09794d2ec50', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47230a9-fffc-40f8-836e-2f70b234b8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47230a9-fffc-40f8-836e-2f70b234b8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ade131-2229-4c12-ac76-729145122968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:37 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Volume 7eb2713a-933d-4abe-8240-f09794d2ec50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb2713a-933d-4abe-8240-f09794d2ec50', 'volume_size': 1}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1080145685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb2713a-933d-4abe-8240-f09794d2ec50,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161cc0f473ea4b698aa8c40ba6513682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:38Z,use_quota=True,user_id='7eb76800dfd6463bba595beff7ce8993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Creating volume 7eb2713a-933d-4abe-8240-f09794d2ec50 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:54:37 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:54:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7eb2713a-933d-4abe-8240-f09794d2ec50 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:37 devstack sudo[88949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7eb2713a-933d-4abe-8240-f09794d2ec50 1073741824
Nov 03 16:54:37 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:38 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7eb2713a-933d-4abe-8240-f09794d2ec50 1073741824" returned: 0 in 0.613s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7eb2713a-933d-4abe-8240-f09794d2ec50 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:38 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7eb2713a-933d-4abe-8240-f09794d2ec50
Nov 03 16:54:38 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:38 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7eb2713a-933d-4abe-8240-f09794d2ec50" returned: 0 in 0.376s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:54:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ade131-2229-4c12-ac76-729145122968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb2713a-933d-4abe-8240-f09794d2ec50', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7deb54-7cf2-420a-8848-dc6dd7337472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:38 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Volume volume-7eb2713a-933d-4abe-8240-f09794d2ec50 (7eb2713a-933d-4abe-8240-f09794d2ec50): created successfully
Nov 03 16:54:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7deb54-7cf2-420a-8848-dc6dd7337472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Flow 'volume_create_manager' (c0497855-2e6e-414e-867f-6678cbf16a62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:54:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-44d872ff-9a23-4e3f-b467-e52d3378b110 tempest-VolumesTestJSON-2079105828 None] Created volume successfully.
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Flow 'volume_create_manager' (01b3f38c-8445-42b3-aca3-412838b3db08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab54f6d-00c9-450b-9f8a-333d9c387993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab54f6d-00c9-450b-9f8a-333d9c387993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1164828540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062bbb31-1c81-41ef-9d5e-1b684dbf4a3b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161cc0f473ea4b698aa8c40ba6513682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:41Z,use_quota=True,user_id='7eb76800dfd6463bba595beff7ce8993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c60c27b-0525-4b99-b925-34ff15f26b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c60c27b-0525-4b99-b925-34ff15f26b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98310662-15c9-40cb-a6aa-712e00d29996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98310662-15c9-40cb-a6aa-712e00d29996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062bbb31-1c81-41ef-9d5e-1b684dbf4a3b', 'volume_name': 'volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c76d5ee-21e1-4b86-a99c-fd529d07c3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c76d5ee-21e1-4b86-a99c-fd529d07c3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd997d8-a403-493f-8460-e08da0d4a9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Volume 062bbb31-1c81-41ef-9d5e-1b684dbf4a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b', 'volume_size': 1}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1164828540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062bbb31-1c81-41ef-9d5e-1b684dbf4a3b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161cc0f473ea4b698aa8c40ba6513682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:41Z,use_quota=True,user_id='7eb76800dfd6463bba595beff7ce8993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Creating volume 062bbb31-1c81-41ef-9d5e-1b684dbf4a3b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:54:40 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:54:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:40 devstack sudo[88981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b 1073741824
Nov 03 16:54:40 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:41 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b 1073741824" returned: 0 in 0.545s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:41 devstack sudo[88987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b
Nov 03 16:54:41 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:41 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b" returned: 0 in 0.298s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:54:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd997d8-a403-493f-8460-e08da0d4a9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a683ce53-1bd5-43b0-81ff-7a6f110fbb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:54:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Volume volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b (062bbb31-1c81-41ef-9d5e-1b684dbf4a3b): created successfully
Nov 03 16:54:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a683ce53-1bd5-43b0-81ff-7a6f110fbb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:54:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Flow 'volume_create_manager' (01b3f38c-8445-42b3-aca3-412838b3db08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:54:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0a6d33c2-d6d2-481a-add3-0eab6f8218fe tempest-VolumesTestJSON-2079105828 None] Created volume successfully.
Nov 03 16:54:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Acquiring lock "cinder-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:54:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Lock "cinder-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:54:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Acquiring lock "cinder-quobyte-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:54:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Lock "cinder-quobyte-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b" acquired by "delete_volume" :: waited 0.041s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:54:45 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0e98fa-1a15-409a-a207-76e2f44c049c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:54:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:45 devstack sudo[89065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b
Nov 03 16:54:45 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:46 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b" returned: 0 in 0.783s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:46 devstack sudo[89073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b
Nov 03 16:54:46 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:46 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b" returned: 0 in 0.558s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Lock "cinder-quobyte-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b" released by "delete_volume" :: held 1.447s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:54:46 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Created reservations ['d11bfe97-468b-4742-9b6b-ce999fa10fdf', 'f4069bb6-8cdd-4b20-a3f5-6b09ba859450', 'a01bca84-d8db-4756-a1dd-f9af118d98d2', '9bb0e2ae-ca51-4d62-bdaf-92a236135106'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:54:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:54:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:54:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:47 devstack sudo[89080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:54:47 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:47 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.339s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:47 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:54:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Deleted volume successfully.
Nov 03 16:54:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d29795c9-a705-4df5-9cff-53b8a5c701bb tempest-VolumesTestJSON-2079105828 None] Lock "cinder-062bbb31-1c81-41ef-9d5e-1b684dbf4a3b-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:54:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Acquiring lock "cinder-7eb2713a-933d-4abe-8240-f09794d2ec50-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:54:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Lock "cinder-7eb2713a-933d-4abe-8240-f09794d2ec50-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:54:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Acquiring lock "cinder-quobyte-7eb2713a-933d-4abe-8240-f09794d2ec50" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:54:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Lock "cinder-quobyte-7eb2713a-933d-4abe-8240-f09794d2ec50" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:54:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fee0f7c-1451-4371-9065-34598662ad46]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:54:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7eb2713a-933d-4abe-8240-f09794d2ec50 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:48 devstack sudo[89096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7eb2713a-933d-4abe-8240-f09794d2ec50
Nov 03 16:54:48 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:48 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7eb2713a-933d-4abe-8240-f09794d2ec50" returned: 0 in 0.504s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7eb2713a-933d-4abe-8240-f09794d2ec50 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:48 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7eb2713a-933d-4abe-8240-f09794d2ec50
Nov 03 16:54:48 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:48 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7eb2713a-933d-4abe-8240-f09794d2ec50" returned: 0 in 0.433s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Lock "cinder-quobyte-7eb2713a-933d-4abe-8240-f09794d2ec50" released by "delete_volume" :: held 1.015s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:54:49 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Created reservations ['77d6f876-4a93-4879-b6b8-ca6f5143e878', '37bff9ef-6cf5-43be-a808-ccc6dc628104', '44427bd0-5eb7-4c09-8470-977e0905629d', 'e57e0b98-87aa-4467-8aa0-9774060aaec4'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:54:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:54:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:54:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:49 devstack sudo[89105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:54:49 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:49 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.462s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:49 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:54:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Deleted volume successfully.
Nov 03 16:54:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-887c2c68-ea2b-4cf9-b1a9-af140d359155 tempest-VolumesTestJSON-2079105828 None] Lock "cinder-7eb2713a-933d-4abe-8240-f09794d2ec50-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:54:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Acquiring lock "cinder-62659714-4863-4a33-aa23-c6f4f20cccf5-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:54:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Lock "cinder-62659714-4863-4a33-aa23-c6f4f20cccf5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:54:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Acquiring lock "cinder-quobyte-62659714-4863-4a33-aa23-c6f4f20cccf5" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:54:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Lock "cinder-quobyte-62659714-4863-4a33-aa23-c6f4f20cccf5" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:54:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d9260d-6c3f-4c37-a820-ec9489468e46]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:54:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62659714-4863-4a33-aa23-c6f4f20cccf5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:50 devstack sudo[89110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62659714-4863-4a33-aa23-c6f4f20cccf5
Nov 03 16:54:50 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:51 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62659714-4863-4a33-aa23-c6f4f20cccf5" returned: 0 in 0.650s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62659714-4863-4a33-aa23-c6f4f20cccf5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:51 devstack sudo[89116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62659714-4863-4a33-aa23-c6f4f20cccf5
Nov 03 16:54:51 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:51 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62659714-4863-4a33-aa23-c6f4f20cccf5" returned: 0 in 0.585s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:54:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:54:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:54:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Lock "cinder-quobyte-62659714-4863-4a33-aa23-c6f4f20cccf5" released by "delete_volume" :: held 1.465s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:54:51 devstack sudo[89132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:54:51 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:51 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Created reservations ['1137e94d-4a3c-44b5-8ebe-e157a9bb240a', '4dde74d1-bf48-4a9a-a89a-8517c9fe3a90', 'b9d3928f-cc9e-422a-9efc-331b5ec0afd8', 'da6d5d4e-5a93-4c36-a7d2-2c4cf6e0a5e3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:54:52 devstack sudo[89151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:54:52 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:54:52 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.597s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 8 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:54:52 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.480s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:54:52 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Deleted volume successfully.
Nov 03 16:54:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9bc322f6-f571-41af-9d9a-011994a8b20b tempest-VolumesTestJSON-2079105828 None] Lock "cinder-62659714-4863-4a33-aa23-c6f4f20cccf5-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:55:02 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=32,cinder:SELECT=20,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:55:02 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=26,cinder:UPDATE=40,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:55:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-53ef952f-1e6e-4574-8868-af88939df952 tempest-GroupsV320Test-1294439016 None] Group tempest-GroupsV320Test-Group-1243322549: creating
Nov 03 16:55:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-53ef952f-1e6e-4574-8868-af88939df952 tempest-GroupsV320Test-1294439016 None] Group tempest-GroupsV320Test-Group-1243322549: created successfully
Nov 03 16:55:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-53ef952f-1e6e-4574-8868-af88939df952 tempest-GroupsV320Test-1294439016 None] Create group completed successfully.
Nov 03 16:55:12 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a6e4ecbf-b5b8-4d02-bd80-5e8b50103d27 tempest-GroupsV320Test-1294439016 None] Created reservations ['afc181ed-43ad-4832-80b5-5738fe516392'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:55:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a6e4ecbf-b5b8-4d02-bd80-5e8b50103d27 tempest-GroupsV320Test-1294439016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a6e4ecbf-b5b8-4d02-bd80-5e8b50103d27 tempest-GroupsV320Test-1294439016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ecbf-b5b8-4d02-bd80-5e8b50103d27 tempest-GroupsV320Test-1294439016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:55:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ecbf-b5b8-4d02-bd80-5e8b50103d27 tempest-GroupsV320Test-1294439016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:55:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a6e4ecbf-b5b8-4d02-bd80-5e8b50103d27 tempest-GroupsV320Test-1294439016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a6e4ecbf-b5b8-4d02-bd80-5e8b50103d27 tempest-GroupsV320Test-1294439016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:12 devstack sudo[89850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:55:12 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:13 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a6e4ecbf-b5b8-4d02-bd80-5e8b50103d27 tempest-GroupsV320Test-1294439016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a6e4ecbf-b5b8-4d02-bd80-5e8b50103d27 tempest-GroupsV320Test-1294439016 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:55:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a6e4ecbf-b5b8-4d02-bd80-5e8b50103d27 tempest-GroupsV320Test-1294439016 None] Delete group completed successfully.
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Flow 'volume_create_manager' (85b5fe46-f435-411f-ba68-cec4064a3948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b675be-5317-4c58-8144-eda215785305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b675be-5317-4c58-8144-eda215785305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1539243578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1707e033593943f28cdda555074a8d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:55:14Z,use_quota=True,user_id='58c1c960403e48bf96bd413e611a29ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f707b78-8f1d-422b-964d-13480e2d6dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f707b78-8f1d-422b-964d-13480e2d6dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432a6fae-6efd-435e-bd18-c25fd31526dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432a6fae-6efd-435e-bd18-c25fd31526dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0', 'volume_name': 'volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31396e8-d68f-4f95-9b6c-e858c916608e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31396e8-d68f-4f95-9b6c-e858c916608e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c042989-69a8-4e6a-9812-ae4d59763cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:13 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Volume e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0', 'volume_size': 1}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1539243578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1707e033593943f28cdda555074a8d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:55:14Z,use_quota=True,user_id='58c1c960403e48bf96bd413e611a29ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Creating volume e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:55:13 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:55:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:13 devstack sudo[89853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0 1073741824
Nov 03 16:55:13 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:14 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0 1073741824" returned: 0 in 0.644s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:14 devstack sudo[89859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0
Nov 03 16:55:14 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:14 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0" returned: 0 in 0.396s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:55:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c042989-69a8-4e6a-9812-ae4d59763cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe942d11-3e94-46cb-9901-f93a7065b135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:14 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Volume volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0 (e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0): created successfully
Nov 03 16:55:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe942d11-3e94-46cb-9901-f93a7065b135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Flow 'volume_create_manager' (85b5fe46-f435-411f-ba68-cec4064a3948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:55:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a564a32c-7275-44f0-869a-5aa3b119f5bb tempest-ServerActionsTestOtherA-1601141223 None] Created volume successfully.
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Flow 'volume_create_manager' (367963a4-b8e8-4e5c-af20-5a6602c47aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119a63f9-fa9c-424e-8302-a705ce203660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119a63f9-fa9c-424e-8302-a705ce203660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1608318733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f84965-24f7-44b2-9ea1-d3ec55d8b180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148d4851dace4007acefb2ad58503a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:55:23Z,use_quota=True,user_id='46891637409c442dadc7862516bbbd7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(028b1c87-f4ba-4447-ba32-7bb3d413838f),volume_type_id=028b1c87-f4ba-4447-ba32-7bb3d413838f)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4fefac-c6e9-4267-9467-ab9cf6f69f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4fefac-c6e9-4267-9467-ab9cf6f69f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c3c9c2-cf0e-46ff-92d0-052722616ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c3c9c2-cf0e-46ff-92d0-052722616ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f84965-24f7-44b2-9ea1-d3ec55d8b180', 'volume_name': 'volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30282bb0-e623-40ae-bdf8-73a491e466d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30282bb0-e623-40ae-bdf8-73a491e466d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d833d5-1f81-4e98-beaf-8fbded6caaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Volume 36f84965-24f7-44b2-9ea1-d3ec55d8b180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180', 'volume_size': 1}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1608318733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f84965-24f7-44b2-9ea1-d3ec55d8b180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148d4851dace4007acefb2ad58503a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:55:23Z,use_quota=True,user_id='46891637409c442dadc7862516bbbd7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(028b1c87-f4ba-4447-ba32-7bb3d413838f),volume_type_id=028b1c87-f4ba-4447-ba32-7bb3d413838f)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Creating volume 36f84965-24f7-44b2-9ea1-d3ec55d8b180 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:55:23 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:23 devstack sudo[89953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180 1073741824
Nov 03 16:55:23 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:23 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180 1073741824" returned: 0 in 0.619s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:23 devstack sudo[89962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180
Nov 03 16:55:23 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:24 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180" returned: 0 in 0.302s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:55:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d833d5-1f81-4e98-beaf-8fbded6caaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9875065-ae34-4572-8700-ecef5544fd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:24 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Volume volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180 (36f84965-24f7-44b2-9ea1-d3ec55d8b180): created successfully
Nov 03 16:55:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9875065-ae34-4572-8700-ecef5544fd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Flow 'volume_create_manager' (367963a4-b8e8-4e5c-af20-5a6602c47aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:55:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c27dbfeb-78b8-431d-ab61-235af8d9d1b6 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Created volume successfully.
Nov 03 16:55:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-79075d4f-1436-4550-ad31-307a0f2d0c94 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-79075d4f-1436-4550-ad31-307a0f2d0c94 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-79075d4f-1436-4550-ad31-307a0f2d0c94 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:55:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-79075d4f-1436-4550-ad31-307a0f2d0c94 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:55:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-79075d4f-1436-4550-ad31-307a0f2d0c94 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-79075d4f-1436-4550-ad31-307a0f2d0c94 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:26 devstack sudo[90014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:55:26 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:26 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-79075d4f-1436-4550-ad31-307a0f2d0c94 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.373s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:26 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-79075d4f-1436-4550-ad31-307a0f2d0c94 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:55:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-79075d4f-1436-4550-ad31-307a0f2d0c94 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Retype volume completed successfully.
Nov 03 16:55:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Acquiring lock "cinder-36f84965-24f7-44b2-9ea1-d3ec55d8b180-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:55:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Lock "cinder-36f84965-24f7-44b2-9ea1-d3ec55d8b180-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:55:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Acquiring lock "cinder-quobyte-36f84965-24f7-44b2-9ea1-d3ec55d8b180" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:55:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Lock "cinder-quobyte-36f84965-24f7-44b2-9ea1-d3ec55d8b180" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:55:27 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23eecd0-e6b9-41ec-b182-fe28eebb70c9]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:55:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:27 devstack sudo[90027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180
Nov 03 16:55:27 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:28 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180" returned: 0 in 0.706s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:28 devstack sudo[90043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180
Nov 03 16:55:28 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-d9394c7e-3ca5-4536-bdb0-c056f8d66a9f req-98dee1e8-ff39-48c3-ba49-c50ffb6b1584 tempest-TaggedAttachmentsTest-1603948028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-d9394c7e-3ca5-4536-bdb0-c056f8d66a9f req-98dee1e8-ff39-48c3-ba49-c50ffb6b1584 tempest-TaggedAttachmentsTest-1603948028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-d9394c7e-3ca5-4536-bdb0-c056f8d66a9f req-98dee1e8-ff39-48c3-ba49-c50ffb6b1584 tempest-TaggedAttachmentsTest-1603948028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-d9394c7e-3ca5-4536-bdb0-c056f8d66a9f req-98dee1e8-ff39-48c3-ba49-c50ffb6b1584 tempest-TaggedAttachmentsTest-1603948028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-0eafa427-2ef1-4547-be6f-95db88a9097d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c726250-1ff4-4a80-8203-43c56262b368', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:55:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-d9394c7e-3ca5-4536-bdb0-c056f8d66a9f req-98dee1e8-ff39-48c3-ba49-c50ffb6b1584 tempest-TaggedAttachmentsTest-1603948028 None] attachment_update completed successfully.
Nov 03 16:55:28 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-36f84965-24f7-44b2-9ea1-d3ec55d8b180" returned: 0 in 0.437s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Lock "cinder-quobyte-36f84965-24f7-44b2-9ea1-d3ec55d8b180" released by "delete_volume" :: held 1.222s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:55:28 devstack cinder-volume[87122]: WARNING cinder.quota [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:55:28 devstack cinder-volume[87122]: WARNING cinder.quota [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:55:28 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Created reservations ['236b4dda-83e7-425c-b9db-ad442acd70a8', 'f3846408-0db1-45c3-b56f-bf05552e67c1', '6c2cca5c-0414-4ecb-b665-643d567e5d62', '5bf5d593-67d6-4ff0-bc3c-1333419db348'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:55:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:55:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:55:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:29 devstack sudo[90147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:55:29 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:29 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:29 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:55:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Deleted volume successfully.
Nov 03 16:55:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2c2c3c11-f288-4465-8944-32702ebec918 tempest-VolumeRetypeWithoutMigrationTest-963398816 None] Lock "cinder-36f84965-24f7-44b2-9ea1-d3ec55d8b180-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Flow 'volume_create_manager' (368acbaa-7ab4-4367-b2ee-19932c4e1c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04eb5a65-3982-4eca-a4cb-6afc7076c238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04eb5a65-3982-4eca-a4cb-6afc7076c238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1420899766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0033d57d-0fdd-4644-98fc-0b840390ba53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ee557580c43549b03929388260e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:55:31Z,use_quota=True,user_id='f9ef1f81641e423f9f8c1fff9c9f71b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acd281e-4f54-4c0e-ad8b-49abe3307593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acd281e-4f54-4c0e-ad8b-49abe3307593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d567b29d-cd72-4571-9c75-5f9190e20d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d567b29d-cd72-4571-9c75-5f9190e20d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0033d57d-0fdd-4644-98fc-0b840390ba53', 'volume_name': 'volume-0033d57d-0fdd-4644-98fc-0b840390ba53', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8122f1-687e-4521-9bd2-bd29ef1d507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8122f1-687e-4521-9bd2-bd29ef1d507a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de21853b-18da-4eff-a576-faf42cc04545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:30 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Volume 0033d57d-0fdd-4644-98fc-0b840390ba53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0033d57d-0fdd-4644-98fc-0b840390ba53', 'volume_size': 1}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1420899766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0033d57d-0fdd-4644-98fc-0b840390ba53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ee557580c43549b03929388260e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:55:31Z,use_quota=True,user_id='f9ef1f81641e423f9f8c1fff9c9f71b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Creating volume 0033d57d-0fdd-4644-98fc-0b840390ba53 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:55:30 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:55:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0033d57d-0fdd-4644-98fc-0b840390ba53 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:30 devstack sudo[90473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0033d57d-0fdd-4644-98fc-0b840390ba53 1073741824
Nov 03 16:55:30 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:31 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0033d57d-0fdd-4644-98fc-0b840390ba53 1073741824" returned: 0 in 0.600s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0033d57d-0fdd-4644-98fc-0b840390ba53 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:31 devstack sudo[90479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0033d57d-0fdd-4644-98fc-0b840390ba53
Nov 03 16:55:31 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:31 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0033d57d-0fdd-4644-98fc-0b840390ba53" returned: 0 in 0.303s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:55:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de21853b-18da-4eff-a576-faf42cc04545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0033d57d-0fdd-4644-98fc-0b840390ba53', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c930d280-519b-4300-92b3-dd694f742983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Volume volume-0033d57d-0fdd-4644-98fc-0b840390ba53 (0033d57d-0fdd-4644-98fc-0b840390ba53): created successfully
Nov 03 16:55:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c930d280-519b-4300-92b3-dd694f742983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Flow 'volume_create_manager' (368acbaa-7ab4-4367-b2ee-19932c4e1c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:55:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-973c17f8-c624-46d1-8661-03ab5727d8d4 tempest-AttachVolumeShelveTestJSON-1018367113 None] Created volume successfully.
Nov 03 16:55:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-0a04de39-ceb6-4f3a-ab03-cdfe2be2a817 req-72122d0c-0fe7-4d97-9228-1c0e2c1ab3e1 tempest-TaggedAttachmentsTest-1603948028 None] Terminate volume connection completed successfully.
Nov 03 16:55:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-0a04de39-ceb6-4f3a-ab03-cdfe2be2a817 req-72122d0c-0fe7-4d97-9228-1c0e2c1ab3e1 tempest-TaggedAttachmentsTest-1603948028 None] Deleting attachment 7c726250-1ff4-4a80-8203-43c56262b368. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Flow 'volume_create_manager' (0faa095d-88bf-46a1-b3e6-f8bc1deb4b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71356181-ab0e-46e4-bd8f-d328f9622c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71356181-ab0e-46e4-bd8f-d328f9622c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-240477591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1922eabd25f1476991521bc7577396b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:55:40Z,use_quota=True,user_id='9ae6c67d0f684f799ef11f37c7a8f595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da359af-5495-43fd-8c03-788a8eaf12f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da359af-5495-43fd-8c03-788a8eaf12f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a606f8e-7b8f-403a-8da4-f6c0d63374fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a606f8e-7b8f-403a-8da4-f6c0d63374fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3', 'volume_name': 'volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7821fda8-0348-4cf6-a62e-cca985ae81da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7821fda8-0348-4cf6-a62e-cca985ae81da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df21b04-17a6-411a-b480-73508e21926e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Volume 79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3', 'volume_size': 1}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-240477591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1922eabd25f1476991521bc7577396b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:55:40Z,use_quota=True,user_id='9ae6c67d0f684f799ef11f37c7a8f595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Creating volume 79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:55:39 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:55:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:40 devstack sudo[90610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 1073741824
Nov 03 16:55:40 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:40 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 1073741824" returned: 0 in 0.558s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:40 devstack sudo[90619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3
Nov 03 16:55:40 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:40 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:55:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df21b04-17a6-411a-b480-73508e21926e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc36189-00db-44c0-be98-306350b2fd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:55:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Volume volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 (79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3): created successfully
Nov 03 16:55:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc36189-00db-44c0-be98-306350b2fd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:55:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Flow 'volume_create_manager' (0faa095d-88bf-46a1-b3e6-f8bc1deb4b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:55:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0ada3809-2a2c-4645-8667-cd7250e10455 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Created volume successfully.
Nov 03 16:55:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Creating offline snapshot 7248892f-9550-44aa-8742-8c9ac0421cef of volume 79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:55:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4f1800-7517-4635-8228-e2292b5ae99d]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:55:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:42 devstack sudo[90642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3
Nov 03 16:55:42 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:42 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3" returned: 0 in 0.444s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:42 devstack sudo[90647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef 1G
Nov 03 16:55:42 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:43 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef 1G" returned: 0 in 0.511s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:43 devstack sudo[90654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef
Nov 03 16:55:43 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-8b748ed0-1382-4da3-9a2c-8757463de1f4 req-21a29b19-0a13-40a8-a336-ebd592a8bfc0 tempest-AttachVolumeShelveTestJSON-1018367113 None] No connector for attachment 49aec4aa-c34c-4730-9e6f-640d4b5f8345; skipping storage backend terminate_connection call. {{(pid=87122) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 03 16:55:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-8b748ed0-1382-4da3-9a2c-8757463de1f4 req-21a29b19-0a13-40a8-a336-ebd592a8bfc0 tempest-AttachVolumeShelveTestJSON-1018367113 None] Deleting attachment 49aec4aa-c34c-4730-9e6f-640d4b5f8345. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:55:43 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef" returned: 0 in 0.348s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:43 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef is being set with open permissions: ugo+rw
Nov 03 16:55:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:43 devstack sudo[90659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef
Nov 03 16:55:43 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:43 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef" returned: 0 in 0.358s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:44 devstack sudo[90664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.info
Nov 03 16:55:44 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Acquiring lock "cinder-0eafa427-2ef1-4547-be6f-95db88a9097d-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:55:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Lock "cinder-0eafa427-2ef1-4547-be6f-95db88a9097d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:55:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Acquiring lock "cinder-quobyte-0eafa427-2ef1-4547-be6f-95db88a9097d" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:55:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Lock "cinder-quobyte-0eafa427-2ef1-4547-be6f-95db88a9097d" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:55:44 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d02742-7b1c-4f42-9dd2-ccaa8a49d5c6]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:55:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0eafa427-2ef1-4547-be6f-95db88a9097d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:44 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.info" returned: 0 in 0.402s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:44 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.info is being set with open permissions: ugo+rw
Nov 03 16:55:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:44 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.info
Nov 03 16:55:44 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:44 devstack sudo[90667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0eafa427-2ef1-4547-be6f-95db88a9097d
Nov 03 16:55:44 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:44 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.info" returned: 0 in 0.285s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fcca93ea-ac64-4d44-bdd0-b1b91d7d4c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Create snapshot completed successfully
Nov 03 16:55:44 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0eafa427-2ef1-4547-be6f-95db88a9097d" returned: 0 in 0.426s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0eafa427-2ef1-4547-be6f-95db88a9097d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:44 devstack sudo[90677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0eafa427-2ef1-4547-be6f-95db88a9097d
Nov 03 16:55:44 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:45 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0eafa427-2ef1-4547-be6f-95db88a9097d" returned: 0 in 0.265s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Lock "cinder-quobyte-0eafa427-2ef1-4547-be6f-95db88a9097d" released by "delete_volume" :: held 0.750s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:55:45 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Created reservations ['7f9fa0fe-1925-4e1e-8599-d4f6a9b9eec4', 'e894ee9c-8091-4c96-ad91-23082168d866', '629f1860-3aa9-4f7e-84e4-b6b01f8ab53b', 'a78371db-5840-4d9a-a242-5f2a24ddcd20'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:55:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:55:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:55:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:45 devstack sudo[90681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:55:45 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:45 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:45 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:55:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Deleted volume successfully.
Nov 03 16:55:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db4f4f41-5055-4efb-b634-f88538e6c088 tempest-TaggedAttachmentsTest-1603948028 None] Lock "cinder-0eafa427-2ef1-4547-be6f-95db88a9097d-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Acquiring lock "cinder-7248892f-9550-44aa-8742-8c9ac0421cef-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "cinder-7248892f-9550-44aa-8742-8c9ac0421cef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Acquiring lock "cinder-quobyte-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "cinder-quobyte-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Acquiring lock "cinder-quobyte-7248892f-9550-44aa-8742-8c9ac0421cef" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "cinder-quobyte-7248892f-9550-44aa-8742-8c9ac0421cef" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Deleting offline snapshot 7248892f-9550-44aa-8742-8c9ac0421cef of volume 79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] snapshot_file for this snap is: volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdca542-156e-4150-84b4-498e65e666e0]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:46 devstack sudo[90684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef
Nov 03 16:55:46 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:46 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef" returned: 0 in 0.409s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0064ba-bfc4-439e-b7e1-b07ed39214ee]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:55:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:46 devstack sudo[90689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3
Nov 03 16:55:46 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:47 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3" returned: 0 in 0.372s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:47 devstack sudo[90694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef
Nov 03 16:55:47 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:47 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef" returned: 0 in 0.436s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:47 devstack sudo[90703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef
Nov 03 16:55:47 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:47 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3.7248892f-9550-44aa-8742-8c9ac0421cef" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "cinder-quobyte-7248892f-9550-44aa-8742-8c9ac0421cef" released by "_delete_snapshot" :: held 1.616s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:55:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "cinder-quobyte-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3" released by "delete_snapshot" :: held 1.641s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:55:47 devstack cinder-volume[87122]: WARNING cinder.quota [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:55:47 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Created reservations ['7a4e151f-71fa-4c78-b346-645021124188', '2219697e-3042-4413-8d2f-14afe9980795', '5ab68245-f56e-4c59-b00f-700cc875069a', '4fcef7ff-ef0b-46af-96a7-ea288d79ada7'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:55:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Delete snapshot completed successfully.
Nov 03 16:55:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e570e92d-04d7-4893-b5b7-8d00b1b37b75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "cinder-7248892f-9550-44aa-8742-8c9ac0421cef-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:55:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Acquiring lock "cinder-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:55:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "cinder-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:55:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Acquiring lock "cinder-quobyte-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:55:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "cinder-quobyte-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3" acquired by "delete_volume" :: waited 0.041s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:55:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[62329c04-93d0-40a4-9312-a0c1b5d00f3f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:55:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:48 devstack sudo[90708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3
Nov 03 16:55:48 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:49 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3" returned: 0 in 0.467s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:49 devstack sudo[90713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3
Nov 03 16:55:49 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:49 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3" returned: 0 in 0.325s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "cinder-quobyte-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3" released by "delete_volume" :: held 0.917s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:55:49 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Created reservations ['8c4654ed-d94f-4fe2-9916-6d3e3a23540c', '1fd5e3d1-039f-4661-8fe3-c07080e22612', 'f0e8798e-1dab-4a6f-b088-80e116ded2ba', '1d9c1bc5-8a84-4510-9e8c-ed84e642d55f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:55:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:55:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:55:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:49 devstack sudo[90720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:55:49 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:50 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.353s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:50 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:55:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Deleted volume successfully.
Nov 03 16:55:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-82ffa581-898e-4327-abd9-075c2b51e495 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980928404 None] Lock "cinder-79d85656-9ca9-4e70-8d5d-6b0bc9ef8ad3-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:55:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-fed697ad-72fd-49e8-8b68-610982a84e91 req-c539fc33-0e55-4ffa-96d5-c9b33b653857 tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-fed697ad-72fd-49e8-8b68-610982a84e91 req-c539fc33-0e55-4ffa-96d5-c9b33b653857 tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-fed697ad-72fd-49e8-8b68-610982a84e91 req-c539fc33-0e55-4ffa-96d5-c9b33b653857 tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-fed697ad-72fd-49e8-8b68-610982a84e91 req-c539fc33-0e55-4ffa-96d5-c9b33b653857 tempest-ServerActionsTestOtherA-1601141223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7c25545-9f72-433b-b356-f0d5dd775dbf', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:55:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-fed697ad-72fd-49e8-8b68-610982a84e91 req-c539fc33-0e55-4ffa-96d5-c9b33b653857 tempest-ServerActionsTestOtherA-1601141223 None] attachment_update completed successfully.
Nov 03 16:55:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:55:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:55:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:55:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:55:51 devstack sudo[91193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:55:51 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:55:52 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root
Nov 03 16:55:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.315s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:55:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:55:56 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-0fd29860-47c5-4bf7-89d3-240ed154f5fe req-3f111fda-76e5-40f5-82bc-c99f37a927c9 tempest-ServerActionsTestOtherA-1601141223 None] Terminate volume connection completed successfully.
Nov 03 16:55:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-0fd29860-47c5-4bf7-89d3-240ed154f5fe req-3f111fda-76e5-40f5-82bc-c99f37a927c9 tempest-ServerActionsTestOtherA-1601141223 None] Deleting attachment b7c25545-9f72-433b-b356-f0d5dd775dbf. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:55:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-0fd29860-47c5-4bf7-89d3-240ed154f5fe req-b321a468-85ff-466a-873d-23eb4d9050fa tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:55:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-0fd29860-47c5-4bf7-89d3-240ed154f5fe req-b321a468-85ff-466a-873d-23eb4d9050fa tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:55:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-0fd29860-47c5-4bf7-89d3-240ed154f5fe req-b321a468-85ff-466a-873d-23eb4d9050fa tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:55:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-0fd29860-47c5-4bf7-89d3-240ed154f5fe req-b321a468-85ff-466a-873d-23eb4d9050fa tempest-ServerActionsTestOtherA-1601141223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '357dad8f-33a9-4917-aa36-7f813c207f81', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:55:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-0fd29860-47c5-4bf7-89d3-240ed154f5fe req-b321a468-85ff-466a-873d-23eb4d9050fa tempest-ServerActionsTestOtherA-1601141223 None] attachment_update completed successfully.
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=68,cinder:INSERT=9,cinder:UPDATE=50,cinder:DELETE=7 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=69,cinder:UPDATE=62,cinder:INSERT=13,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Flow 'volume_create_manager' (a85d201d-9d8b-4c17-8d99-c13857c5cd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5b61c7-41b4-44b3-910e-9d5acff8c198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5b61c7-41b4-44b3-910e-9d5acff8c198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1073962378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d996c9ff-2ce9-4f6c-bed9-af6cf4853539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cfc58f704b548b993eb14135da12b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:56:04Z,use_quota=True,user_id='3447328b8bc149419e73d1cf42e9c6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dafe90ab-f9d9-42d9-b00c-bf60e21e0af4),volume_type_id=dafe90ab-f9d9-42d9-b00c-bf60e21e0af4)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da0e712c-4373-47c0-9448-3483467afec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da0e712c-4373-47c0-9448-3483467afec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6408b2-9e5b-4b16-9670-db6b39f68e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6408b2-9e5b-4b16-9670-db6b39f68e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd996c9ff-2ce9-4f6c-bed9-af6cf4853539', 'volume_name': 'volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681bd2ba-3d78-4cb7-8573-bc605aee570a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681bd2ba-3d78-4cb7-8573-bc605aee570a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18ae563-81b5-40b6-937a-c400ae21d36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:04 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Volume d996c9ff-2ce9-4f6c-bed9-af6cf4853539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539', 'volume_size': 1}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1073962378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d996c9ff-2ce9-4f6c-bed9-af6cf4853539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cfc58f704b548b993eb14135da12b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:56:04Z,use_quota=True,user_id='3447328b8bc149419e73d1cf42e9c6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dafe90ab-f9d9-42d9-b00c-bf60e21e0af4),volume_type_id=dafe90ab-f9d9-42d9-b00c-bf60e21e0af4)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Creating volume d996c9ff-2ce9-4f6c-bed9-af6cf4853539 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:56:04 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:56:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:04 devstack sudo[91841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539 1073741824
Nov 03 16:56:04 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:05 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539 1073741824" returned: 0 in 0.788s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:05 devstack sudo[91847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539
Nov 03 16:56:05 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:05 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539" returned: 0 in 0.440s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:56:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:56:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18ae563-81b5-40b6-937a-c400ae21d36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59815ae5-ace8-40b4-aa04-014a4c6cbfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:05 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Volume volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539 (d996c9ff-2ce9-4f6c-bed9-af6cf4853539): created successfully
Nov 03 16:56:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59815ae5-ace8-40b4-aa04-014a4c6cbfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Flow 'volume_create_manager' (a85d201d-9d8b-4c17-8d99-c13857c5cd4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:56:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7c9dd732-913e-43f7-9481-89055c585718 tempest-VolumeTypesAccessTest-874261641 None] Created volume successfully.
Nov 03 16:56:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Acquiring lock "cinder-d996c9ff-2ce9-4f6c-bed9-af6cf4853539-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:56:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Lock "cinder-d996c9ff-2ce9-4f6c-bed9-af6cf4853539-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:56:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Acquiring lock "cinder-quobyte-d996c9ff-2ce9-4f6c-bed9-af6cf4853539" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:56:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Lock "cinder-quobyte-d996c9ff-2ce9-4f6c-bed9-af6cf4853539" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:56:06 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab88e0dd-3efd-42c9-b750-c91b8d3982d2]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:56:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:06 devstack sudo[91850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539
Nov 03 16:56:06 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:07 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539" returned: 0 in 0.405s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:07 devstack sudo[91855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539
Nov 03 16:56:07 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:07 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d996c9ff-2ce9-4f6c-bed9-af6cf4853539" returned: 0 in 0.331s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Lock "cinder-quobyte-d996c9ff-2ce9-4f6c-bed9-af6cf4853539" released by "delete_volume" :: held 0.799s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:56:07 devstack cinder-volume[87122]: WARNING cinder.quota [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-605977281 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-605977281, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:56:07 devstack cinder-volume[87122]: WARNING cinder.quota [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-605977281 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-605977281, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Created reservations ['8bfaf4fe-f02d-4ca9-adc1-cc90e01df700', '892a0004-6a04-49bc-b486-8818592059ca', '6fd621ea-d785-4596-8c49-744170b59b30', '5771133b-fac3-4784-9acd-32ef479473c0'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:07 devstack sudo[91858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:56:07 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:07 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:56:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Deleted volume successfully.
Nov 03 16:56:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ee903287-f2be-4933-88c5-8a66d5896d11 tempest-VolumeTypesAccessTest-874261641 None] Lock "cinder-d996c9ff-2ce9-4f6c-bed9-af6cf4853539-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:56:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Acquiring lock "cinder-0033d57d-0fdd-4644-98fc-0b840390ba53-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:56:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Lock "cinder-0033d57d-0fdd-4644-98fc-0b840390ba53-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:56:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Acquiring lock "cinder-quobyte-0033d57d-0fdd-4644-98fc-0b840390ba53" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:56:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Lock "cinder-quobyte-0033d57d-0fdd-4644-98fc-0b840390ba53" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:56:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb3304b-c274-4f26-a64e-06bf9f495093]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:56:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0033d57d-0fdd-4644-98fc-0b840390ba53 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:22 devstack sudo[91993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0033d57d-0fdd-4644-98fc-0b840390ba53
Nov 03 16:56:22 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:23 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0033d57d-0fdd-4644-98fc-0b840390ba53" returned: 0 in 0.523s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0033d57d-0fdd-4644-98fc-0b840390ba53 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:23 devstack sudo[92018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0033d57d-0fdd-4644-98fc-0b840390ba53
Nov 03 16:56:23 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:23 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0033d57d-0fdd-4644-98fc-0b840390ba53" returned: 0 in 0.334s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Lock "cinder-quobyte-0033d57d-0fdd-4644-98fc-0b840390ba53" released by "delete_volume" :: held 0.930s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:56:23 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Created reservations ['17dcd1d0-2b82-475b-963d-23e0d24b60c3', '5b8ca0d2-e5c6-4a6c-925b-ba9fb3ceaaf6', '2379fb12-c4cd-4c30-9dd8-9cef4a4e4178', 'fb082117-9c20-4bad-bc48-0d8fdc462561'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:56:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:56:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:56:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:56:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:56:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:56:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:23 devstack sudo[92021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:56:23 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:23 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.400s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:23 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:56:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Deleted volume successfully.
Nov 03 16:56:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce675b32-9d20-4063-80cc-d3f80f47e32d tempest-AttachVolumeShelveTestJSON-1018367113 None] Lock "cinder-0033d57d-0fdd-4644-98fc-0b840390ba53-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Flow 'volume_create_manager' (6df7b1d8-ad21-464e-854e-abc3de245473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409ba2ae-b5cb-4b0a-ac5c-9b853c33ec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409ba2ae-b5cb-4b0a-ac5c-9b853c33ec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-210094823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6134eeac-fd28-4933-8d09-eaa08a9a81ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c3b40da2c84d0bba29e3bddef5cd77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:56:31Z,use_quota=True,user_id='2b3d3439afac4c76b67d5aba01cd36c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a23bcf4-f36a-4021-b537-93fa745ddf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a23bcf4-f36a-4021-b537-93fa745ddf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30947453-54a8-4df4-9a9c-d769b9b1f366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30947453-54a8-4df4-9a9c-d769b9b1f366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6134eeac-fd28-4933-8d09-eaa08a9a81ec', 'volume_name': 'volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b62e9f-b10a-4ca6-9c60-0d54b6647dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b62e9f-b10a-4ca6-9c60-0d54b6647dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c912454-8997-4c9a-a00f-31ba61a05d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Volume 6134eeac-fd28-4933-8d09-eaa08a9a81ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec', 'volume_size': 1}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-210094823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6134eeac-fd28-4933-8d09-eaa08a9a81ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c3b40da2c84d0bba29e3bddef5cd77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:56:31Z,use_quota=True,user_id='2b3d3439afac4c76b67d5aba01cd36c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Creating volume 6134eeac-fd28-4933-8d09-eaa08a9a81ec {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:56:31 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:56:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:31 devstack sudo[92156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec 1073741824
Nov 03 16:56:31 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:32 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec 1073741824" returned: 0 in 0.922s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:32 devstack sudo[92166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec
Nov 03 16:56:32 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:33 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec" returned: 0 in 0.462s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:56:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:56:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c912454-8997-4c9a-a00f-31ba61a05d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7c3bae-04ea-4933-83ec-13e30b91b180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Volume volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec (6134eeac-fd28-4933-8d09-eaa08a9a81ec): created successfully
Nov 03 16:56:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7c3bae-04ea-4933-83ec-13e30b91b180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Flow 'volume_create_manager' (6df7b1d8-ad21-464e-854e-abc3de245473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:56:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f59dcde1-05fe-43f3-ad86-a50eb1cce819 tempest-SnapshotMetadataTestJSON-2073792345 None] Created volume successfully.
Nov 03 16:56:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-b6c320f4-916d-48f6-af47-c683c34388fe req-34daa04c-3111-40b5-b6ba-5fb814f24653 tempest-ServerActionsTestOtherA-1601141223 None] Terminate volume connection completed successfully.
Nov 03 16:56:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-b6c320f4-916d-48f6-af47-c683c34388fe req-34daa04c-3111-40b5-b6ba-5fb814f24653 tempest-ServerActionsTestOtherA-1601141223 None] Deleting attachment 357dad8f-33a9-4917-aa36-7f813c207f81. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:56:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:56:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:56:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] Creating offline snapshot 0019f950-0beb-45f3-8f54-fa7b0b7f6e11 of volume 6134eeac-fd28-4933-8d09-eaa08a9a81ec {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:56:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fce7d5-ee9e-4b08-a7fe-214fc9e423b3]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:56:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:34 devstack sudo[92173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec
Nov 03 16:56:34 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:34 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec" returned: 0 in 0.881s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:35 devstack sudo[92180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11 1G
Nov 03 16:56:35 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:36 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11 1G" returned: 0 in 1.213s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:36 devstack sudo[92208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11
Nov 03 16:56:36 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:36 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11" returned: 0 in 0.643s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:36 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11 is being set with open permissions: ugo+rw
Nov 03 16:56:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:36 devstack sudo[92215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11
Nov 03 16:56:36 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:37 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11" returned: 0 in 0.695s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:37 devstack sudo[92219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.info
Nov 03 16:56:37 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:38 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.info" returned: 0 in 0.525s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:38 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.info is being set with open permissions: ugo+rw
Nov 03 16:56:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:38 devstack sudo[92223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.info
Nov 03 16:56:38 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:38 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.info" returned: 0 in 0.475s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.676s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:56:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-915424a4-69f4-45ae-ad5f-089f078cbace tempest-SnapshotMetadataTestJSON-2073792345 None] Create snapshot completed successfully
Nov 03 16:56:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Acquiring lock "cinder-0019f950-0beb-45f3-8f54-fa7b0b7f6e11-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:56:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "cinder-0019f950-0beb-45f3-8f54-fa7b0b7f6e11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:56:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Acquiring lock "cinder-quobyte-6134eeac-fd28-4933-8d09-eaa08a9a81ec" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:56:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "cinder-quobyte-6134eeac-fd28-4933-8d09-eaa08a9a81ec" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:56:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Acquiring lock "cinder-quobyte-0019f950-0beb-45f3-8f54-fa7b0b7f6e11" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:56:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "cinder-quobyte-0019f950-0beb-45f3-8f54-fa7b0b7f6e11" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:56:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Deleting offline snapshot 0019f950-0beb-45f3-8f54-fa7b0b7f6e11 of volume 6134eeac-fd28-4933-8d09-eaa08a9a81ec {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:56:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] snapshot_file for this snap is: volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:56:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a108dd75-95c8-4ccd-99dc-b35b908d9d58]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:56:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:41 devstack sudo[92268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11
Nov 03 16:56:41 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:42 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11" returned: 0 in 0.804s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:56:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[43982fa1-c81d-4784-a918-4b1dc452c21b]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:56:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:42 devstack sudo[92275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec
Nov 03 16:56:42 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:43 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec" returned: 0 in 0.895s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:43 devstack sudo[92282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11
Nov 03 16:56:43 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:43 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11" returned: 0 in 0.709s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:43 devstack sudo[92307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11
Nov 03 16:56:43 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:44 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec.0019f950-0beb-45f3-8f54-fa7b0b7f6e11" returned: 0 in 0.578s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Flow 'volume_create_manager' (beb163fb-9ae0-4db3-9036-95680dbb9932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5591ca8-c1a8-4140-9cb8-d5c2dcae43d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5591ca8-c1a8-4140-9cb8-d5c2dcae43d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1560226287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe5027d-7230-4c7b-b7d0-b940baf5b928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd52e7bf58de47b084e989be76960319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:56:44Z,use_quota=True,user_id='4dd15771190e41d5a9237ad61e620cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafc4505-ce4b-4b6a-96d6-176ac3851c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafc4505-ce4b-4b6a-96d6-176ac3851c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d060778-10cf-45e0-b08f-2e3577cb3789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d060778-10cf-45e0-b08f-2e3577cb3789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfe5027d-7230-4c7b-b7d0-b940baf5b928', 'volume_name': 'volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ea2614-2d6d-4ac5-af25-22a3cece2507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ea2614-2d6d-4ac5-af25-22a3cece2507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3567178-abc8-4fea-9c14-650747869fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:44 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Volume bfe5027d-7230-4c7b-b7d0-b940baf5b928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928', 'volume_size': 1}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1560226287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe5027d-7230-4c7b-b7d0-b940baf5b928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd52e7bf58de47b084e989be76960319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:56:44Z,use_quota=True,user_id='4dd15771190e41d5a9237ad61e620cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Creating volume bfe5027d-7230-4c7b-b7d0-b940baf5b928 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:56:44 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "cinder-quobyte-0019f950-0beb-45f3-8f54-fa7b0b7f6e11" released by "_delete_snapshot" :: held 3.333s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:56:44 devstack sudo[92310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928 1073741824
Nov 03 16:56:44 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "cinder-quobyte-6134eeac-fd28-4933-8d09-eaa08a9a81ec" released by "delete_snapshot" :: held 3.376s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Created reservations ['59e680f0-9155-4f08-8abb-cee14fd88722', 'b3b89e59-f077-45ec-a566-4c1a6c3096b8', 'dabc85d2-7fe4-4796-bad6-c34fe39c7768', 'aab2cf7a-b6e5-42d2-b34f-89fe21304720'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:56:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Delete snapshot completed successfully.
Nov 03 16:56:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94658c1c-6788-4ba6-9fb3-7c4d2d998fa3 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "cinder-0019f950-0beb-45f3-8f54-fa7b0b7f6e11-delete_snapshot" released by "delete_snapshot" :: held 3.634s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:56:45 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928 1073741824" returned: 0 in 0.801s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Flow 'volume_create_manager' (2e6eeae6-2664-4f1c-b5a5-cce10c223f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5787cf0-51d1-409b-8acb-04572c8f343a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5787cf0-51d1-409b-8acb-04572c8f343a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-830763921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ad7443-2172-4460-9574-7e1ccad3bb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1707e033593943f28cdda555074a8d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:56:45Z,use_quota=True,user_id='58c1c960403e48bf96bd413e611a29ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd370b56-8eb9-4d6a-9d0f-4a91d13c6ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd370b56-8eb9-4d6a-9d0f-4a91d13c6ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4527468b-8862-481c-ba02-aff29f0e7830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:45 devstack sudo[92315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928
Nov 03 16:56:45 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Acquiring lock "cinder-6134eeac-fd28-4933-8d09-eaa08a9a81ec-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "cinder-6134eeac-fd28-4933-8d09-eaa08a9a81ec-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Acquiring lock "cinder-quobyte-6134eeac-fd28-4933-8d09-eaa08a9a81ec" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "cinder-quobyte-6134eeac-fd28-4933-8d09-eaa08a9a81ec" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86c2361-1833-4ac6-a89c-751e66f046c4]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:56:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4527468b-8862-481c-ba02-aff29f0e7830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33ad7443-2172-4460-9574-7e1ccad3bb6e', 'volume_name': 'volume-33ad7443-2172-4460-9574-7e1ccad3bb6e', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e72452b2c30>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db4a77f-f251-4bff-a53f-b9dcdb7a4ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:46 devstack sudo[92317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec
Nov 03 16:56:46 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db4a77f-f251-4bff-a53f-b9dcdb7a4ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c44b93-9260-4d89-af55-2d7c7f6dbc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:46 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Volume 33ad7443-2172-4460-9574-7e1ccad3bb6e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33ad7443-2172-4460-9574-7e1ccad3bb6e', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e72452b2c30>}
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Trying to clone 33ad7443-2172-4460-9574-7e1ccad3bb6e from image 12ab4fb0-81c3-4967-9eea-39afb443d41b at location (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 16:56:46 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928" returned: 0 in 0.529s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3567178-abc8-4fea-9c14-650747869fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0f9d48-bfb0-4042-9f47-5574f36ca273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:46 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Volume volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928 (bfe5027d-7230-4c7b-b7d0-b940baf5b928): created successfully
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0f9d48-bfb0-4042-9f47-5574f36ca273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Flow 'volume_create_manager' (beb163fb-9ae0-4db3-9036-95680dbb9932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:56:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-dbd376c2-2e8a-4fb2-9a22-a4f63962bf17 tempest-ServerRescueNegativeTestJSON-2014765533 None] Created volume successfully.
Nov 03 16:56:46 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec" returned: 0 in 0.507s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:46 devstack sudo[92343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec
Nov 03 16:56:46 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:46 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6134eeac-fd28-4933-8d09-eaa08a9a81ec" returned: 0 in 0.392s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "cinder-quobyte-6134eeac-fd28-4933-8d09-eaa08a9a81ec" released by "delete_volume" :: held 1.014s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 16:56:46 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 16:56:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a395f5-8b48-41d4-801c-9d6b3bdab8b7]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Created reservations ['e3d65cf5-cc7b-4b40-bbb2-712da1bbb453', '629f0f23-bd7d-4bdb-bf43-3d10268063e3', 'a1e3204b-87f4-44a3-892b-7667ff53f1ae', 'a8c04f29-923c-4a70-9150-1447a16fbc0f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:47 devstack sudo[92349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:56:47 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:47 devstack sudo[92348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD
Nov 03 16:56:47 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:47 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.575s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:56:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Deleted volume successfully.
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e6dfeaf3-262b-4e75-90fd-e3bb887e5b55 tempest-SnapshotMetadataTestJSON-2073792345 None] Lock "cinder-6134eeac-fd28-4933-8d09-eaa08a9a81ec-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:56:47 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Temporary image 12ab4fb0-81c3-4967-9eea-39afb443d41b is fetched for user 58c1c960403e48bf96bd413e611a29ca. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[25eebfd2-4e11-4130-a439-3bd9868e7e3c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:56:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:48 devstack sudo[92357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD
Nov 03 16:56:48 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:48 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD" returned: 0 in 0.635s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:56:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:56:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-830763921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ad7443-2172-4460-9574-7e1ccad3bb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1707e033593943f28cdda555074a8d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:56:45Z,use_quota=True,user_id='58c1c960403e48bf96bd413e611a29ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:56:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Creating volume 33ad7443-2172-4460-9574-7e1ccad3bb6e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:56:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:56:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:56:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:56:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:56:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:56:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:56:48 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:56:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:48 devstack sudo[92364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e 1073741824
Nov 03 16:56:48 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:49 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e 1073741824" returned: 0 in 0.951s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:49 devstack sudo[92380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e
Nov 03 16:56:49 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e" returned: 0 in 0.564s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:50 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:56:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:56:50 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Attempting download of 12ab4fb0-81c3-4967-9eea-39afb443d41b ((None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}])) to volume 33ad7443-2172-4460-9574-7e1ccad3bb6e. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 16:56:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5980c4-162a-4323-a354-860bd0b8a859]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:56:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_e5pv_4jq {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:50 devstack sudo[92407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_e5pv_4jq
Nov 03 16:56:50 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:51 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_e5pv_4jq" returned: 0 in 0.733s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_e5pv_4jq {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:51 devstack sudo[92411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_e5pv_4jq
Nov 03 16:56:51 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:51 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_e5pv_4jq" returned: 1 in 0.407s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_e5pv_4jq' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:56:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[df05ffd2-d6d4-4b54-b40d-b160bd09f7b9]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:56:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:51 devstack sudo[92415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD
Nov 03 16:56:51 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:56:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:56:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:56:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:56:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:56:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:56:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:51 devstack sudo[92418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:56:51 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:52 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:52 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] 12ab4fb0-81c3-4967-9eea-39afb443d41b was qcow2, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 16:56:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:52 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.634s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:56:52 devstack sudo[92425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e
Nov 03 16:56:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:56:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:56:52 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:56:56 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e" returned: 0 in 3.731s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:56 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_g7cs8l0ddevstack@QuobyteHD, size 112.00 MB, duration 3.73 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:56:56 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Converted 112.00 MB image at 30.01 MB/s
Nov 03 16:56:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:56 devstack sudo[92451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e 1G
Nov 03 16:56:56 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:56:56 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root
Nov 03 16:56:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e 1G" returned: 0 in 0.546s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:56:56 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Downloaded image 12ab4fb0-81c3-4967-9eea-39afb443d41b ((None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}])) to volume 33ad7443-2172-4460-9574-7e1ccad3bb6e successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 16:56:56 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Temporary image 12ab4fb0-81c3-4967-9eea-39afb443d41b for user 58c1c960403e48bf96bd413e611a29ca is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 16:56:56 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Marking volume 33ad7443-2172-4460-9574-7e1ccad3bb6e as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 16:56:56 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Copying metadata from image 12ab4fb0-81c3-4967-9eea-39afb443d41b to 33ad7443-2172-4460-9574-7e1ccad3bb6e. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 16:56:56 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Creating volume glance metadata for volume 33ad7443-2172-4460-9574-7e1ccad3bb6e backed by image 12ab4fb0-81c3-4967-9eea-39afb443d41b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 16:56:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c44b93-9260-4d89-af55-2d7c7f6dbc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ad7443-2172-4460-9574-7e1ccad3bb6e', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e72452b2c30>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2bb674-fef3-4e76-9b8e-29e820ce71a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:56:56 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Volume volume-33ad7443-2172-4460-9574-7e1ccad3bb6e (33ad7443-2172-4460-9574-7e1ccad3bb6e): created successfully
Nov 03 16:56:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2bb674-fef3-4e76-9b8e-29e820ce71a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:56:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Flow 'volume_create_manager' (2e6eeae6-2664-4f1c-b5a5-cce10c223f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:56:56 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-80a440f9-6886-4cf7-9936-3f727bdea52c tempest-ServerActionsTestOtherA-1601141223 None] Created volume successfully.
Nov 03 16:56:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Acquiring lock "cinder-bfe5027d-7230-4c7b-b7d0-b940baf5b928-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:56:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Lock "cinder-bfe5027d-7230-4c7b-b7d0-b940baf5b928-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:56:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Acquiring lock "cinder-quobyte-bfe5027d-7230-4c7b-b7d0-b940baf5b928" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:56:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Lock "cinder-quobyte-bfe5027d-7230-4c7b-b7d0-b940baf5b928" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:56:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3ebb6c-0ae2-4710-a663-edac024e606f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:56:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:56:59 devstack sudo[92485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928
Nov 03 16:56:59 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:00 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928" returned: 0 in 0.692s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:00 devstack sudo[92492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928
Nov 03 16:57:00 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:01 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bfe5027d-7230-4c7b-b7d0-b940baf5b928" returned: 0 in 0.514s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Lock "cinder-quobyte-bfe5027d-7230-4c7b-b7d0-b940baf5b928" released by "delete_volume" :: held 1.298s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:57:01 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Created reservations ['341aa8aa-cd3a-4d37-9654-d8820a05e4a6', '31214024-1a16-4820-a476-4d9f024becaa', 'db65c398-39ac-40e2-ba67-9d7a10984233', '6572e8f2-7089-4d3b-848c-7ff27c31006a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:57:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:57:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:57:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:01 devstack sudo[92501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:57:01 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:01 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.437s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:01 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:57:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Deleted volume successfully.
Nov 03 16:57:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d52fb937-0eeb-4515-9c0a-426cd09a9f4e tempest-ServerRescueNegativeTestJSON-2014765533 None] Lock "cinder-bfe5027d-7230-4c7b-b7d0-b940baf5b928-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:57:04 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=44,cinder:UPDATE=52,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:57:04 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=49,cinder:UPDATE=53,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:57:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-d616dc35-0aee-4725-8914-2e7ea81801bf req-678130e5-d606-4d82-b5c0-957f0583022c tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-d616dc35-0aee-4725-8914-2e7ea81801bf req-678130e5-d606-4d82-b5c0-957f0583022c tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-d616dc35-0aee-4725-8914-2e7ea81801bf req-678130e5-d606-4d82-b5c0-957f0583022c tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.063s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-d616dc35-0aee-4725-8914-2e7ea81801bf req-678130e5-d606-4d82-b5c0-957f0583022c tempest-ServerActionsTestOtherA-1601141223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-33ad7443-2172-4460-9574-7e1ccad3bb6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66340280-aa34-4846-bf1e-42a78b954598', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:57:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-d616dc35-0aee-4725-8914-2e7ea81801bf req-678130e5-d606-4d82-b5c0-957f0583022c tempest-ServerActionsTestOtherA-1601141223 None] attachment_update completed successfully.
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Flow 'volume_create_manager' (d70f3d89-aa6f-4bf1-81a2-a7f4335e247e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f6f742-a2ae-4ffa-8a61-51f8c08aa136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f6f742-a2ae-4ffa-8a61-51f8c08aa136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-698944271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc61411-a0ff-45ea-881a-1f2fc6e10de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76c536019e64c8597f1c213a8cae6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:06Z,use_quota=True,user_id='0f096280b21f4a6495b6f2a223b09412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8c9ec4-cf79-404e-9884-e44829bc4610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8c9ec4-cf79-404e-9884-e44829bc4610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1b610e-5a43-47c3-b802-2cc60fa8347d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1b610e-5a43-47c3-b802-2cc60fa8347d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abc61411-a0ff-45ea-881a-1f2fc6e10de7', 'volume_name': 'volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b75d1b-53da-4c2c-8f5b-6490c71ab3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b75d1b-53da-4c2c-8f5b-6490c71ab3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d916ecf-0ca9-421d-a008-a0984abecb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Volume abc61411-a0ff-45ea-881a-1f2fc6e10de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7', 'volume_size': 1}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-698944271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc61411-a0ff-45ea-881a-1f2fc6e10de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76c536019e64c8597f1c213a8cae6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:06Z,use_quota=True,user_id='0f096280b21f4a6495b6f2a223b09412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Creating volume abc61411-a0ff-45ea-881a-1f2fc6e10de7 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:57:06 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:57:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:06 devstack sudo[92599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7 1073741824
Nov 03 16:57:06 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:07 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7 1073741824" returned: 0 in 0.695s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:07 devstack sudo[92605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7
Nov 03 16:57:07 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:07 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7" returned: 0 in 0.353s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:57:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d916ecf-0ca9-421d-a008-a0984abecb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2631513-724a-4d05-8e5d-8bb303b8530e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:07 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Volume volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7 (abc61411-a0ff-45ea-881a-1f2fc6e10de7): created successfully
Nov 03 16:57:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2631513-724a-4d05-8e5d-8bb303b8530e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Flow 'volume_create_manager' (d70f3d89-aa6f-4bf1-81a2-a7f4335e247e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:57:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-85d81bcf-db56-4801-bc07-f298f91483fa tempest-AbsoluteLimitsTests-136332392 None] Created volume successfully.
Nov 03 16:57:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Acquiring lock "cinder-abc61411-a0ff-45ea-881a-1f2fc6e10de7-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:57:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Lock "cinder-abc61411-a0ff-45ea-881a-1f2fc6e10de7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:57:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Acquiring lock "cinder-quobyte-abc61411-a0ff-45ea-881a-1f2fc6e10de7" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:57:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Lock "cinder-quobyte-abc61411-a0ff-45ea-881a-1f2fc6e10de7" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:57:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0924eaae-05e3-452f-8167-1e939190bb05]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:57:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:09 devstack sudo[92636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7
Nov 03 16:57:09 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:09 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7" returned: 0 in 0.513s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:09 devstack sudo[92722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7
Nov 03 16:57:09 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:10 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc61411-a0ff-45ea-881a-1f2fc6e10de7" returned: 0 in 0.459s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Lock "cinder-quobyte-abc61411-a0ff-45ea-881a-1f2fc6e10de7" released by "delete_volume" :: held 1.063s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:57:10 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Created reservations ['4b9eba8d-170a-4b83-a721-678898c747f9', '7ff51872-02d5-4675-a6e3-f8a1e6c598c3', '33d7af9f-24d3-4f93-9436-f333fa7da901', 'a64fe5ac-27ca-419a-b102-f95f9a0c03a2'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:57:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:57:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:57:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:10 devstack sudo[93087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:57:10 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:11 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.527s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:11 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:57:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Deleted volume successfully.
Nov 03 16:57:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce21e09a-abec-4973-93d3-8d1ad84544da tempest-AbsoluteLimitsTests-136332392 None] Lock "cinder-abc61411-a0ff-45ea-881a-1f2fc6e10de7-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:57:20 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=11,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:57:21 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=14,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Flow 'volume_create_manager' (2fa6b088-e0c6-4e0f-a789-6998deaa155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e38414-3640-4582-9d04-5e0201af3ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e38414-3640-4582-9d04-5e0201af3ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1853884141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27dcb648-9078-41f2-9d3f-92e6101a104e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21451ec2551483c872dc2e9993420a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:30Z,use_quota=True,user_id='4b4939ad89d3404ca1fc0e09a884d402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3066edfa-8045-4657-a6db-8203c5db938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3066edfa-8045-4657-a6db-8203c5db938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fec340c-b19a-4d3f-8ff5-04c47db5880b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fec340c-b19a-4d3f-8ff5-04c47db5880b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27dcb648-9078-41f2-9d3f-92e6101a104e', 'volume_name': 'volume-27dcb648-9078-41f2-9d3f-92e6101a104e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cc6a4d-7c48-4cdd-99cb-f34d7790638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cc6a4d-7c48-4cdd-99cb-f34d7790638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a280b6d7-2733-428f-b961-e5fec1bc0d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:30 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Volume 27dcb648-9078-41f2-9d3f-92e6101a104e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27dcb648-9078-41f2-9d3f-92e6101a104e', 'volume_size': 1}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1853884141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27dcb648-9078-41f2-9d3f-92e6101a104e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21451ec2551483c872dc2e9993420a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:30Z,use_quota=True,user_id='4b4939ad89d3404ca1fc0e09a884d402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Creating volume 27dcb648-9078-41f2-9d3f-92e6101a104e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:57:30 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-27dcb648-9078-41f2-9d3f-92e6101a104e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:30 devstack sudo[93250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-27dcb648-9078-41f2-9d3f-92e6101a104e 1073741824
Nov 03 16:57:30 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:30 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-27dcb648-9078-41f2-9d3f-92e6101a104e 1073741824" returned: 0 in 0.702s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Flow 'volume_create_manager' (b4b7d46b-654f-4a13-b269-64da28b5db4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477aced7-18bd-4054-becd-dccbe0072153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-27dcb648-9078-41f2-9d3f-92e6101a104e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:31 devstack sudo[93255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-27dcb648-9078-41f2-9d3f-92e6101a104e
Nov 03 16:57:31 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477aced7-18bd-4054-becd-dccbe0072153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2130218326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d82027-6837-4844-a1c4-909fca2ed081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2152e4f7ea23427caffdca30ccf6b215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:31Z,use_quota=True,user_id='b939f1e0922541b088d904fc3cd28d25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25391a53-f022-4bdb-90bf-89224d8b1834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25391a53-f022-4bdb-90bf-89224d8b1834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85044367-2356-4690-8e38-6c29895e010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85044367-2356-4690-8e38-6c29895e010f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d82027-6837-4844-a1c4-909fca2ed081', 'volume_name': 'volume-76d82027-6837-4844-a1c4-909fca2ed081', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f63fef0-5ac4-4231-a3af-61c98927ff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f63fef0-5ac4-4231-a3af-61c98927ff4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7502701d-3ff7-4894-bfaa-3e6aad5d0ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Volume 76d82027-6837-4844-a1c4-909fca2ed081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d82027-6837-4844-a1c4-909fca2ed081', 'volume_size': 1}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:31 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-27dcb648-9078-41f2-9d3f-92e6101a104e" returned: 0 in 0.355s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.294s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2130218326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d82027-6837-4844-a1c4-909fca2ed081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2152e4f7ea23427caffdca30ccf6b215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:31Z,use_quota=True,user_id='b939f1e0922541b088d904fc3cd28d25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Creating volume 76d82027-6837-4844-a1c4-909fca2ed081 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:57:31 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:31 devstack sudo[93272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081 1073741824
Nov 03 16:57:31 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a280b6d7-2733-428f-b961-e5fec1bc0d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27dcb648-9078-41f2-9d3f-92e6101a104e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288943b2-e3a0-4b8f-8641-15672fde8f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Volume volume-27dcb648-9078-41f2-9d3f-92e6101a104e (27dcb648-9078-41f2-9d3f-92e6101a104e): created successfully
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288943b2-e3a0-4b8f-8641-15672fde8f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Flow 'volume_create_manager' (2fa6b088-e0c6-4e0f-a789-6998deaa155f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:57:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5bec9e0a-49b0-4719-ac7c-ba5b35229e74 tempest-VolumesTransfersV357Test-1572850446 None] Created volume successfully.
Nov 03 16:57:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-8a94e180-0767-45fe-8fc7-e11d64befd32 req-7e04e0a2-ee93-4939-afaa-39b80c37a3c2 tempest-ServerActionsTestOtherA-1601141223 None] Terminate volume connection completed successfully.
Nov 03 16:57:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-8a94e180-0767-45fe-8fc7-e11d64befd32 req-7e04e0a2-ee93-4939-afaa-39b80c37a3c2 tempest-ServerActionsTestOtherA-1601141223 None] Deleting attachment 66340280-aa34-4846-bf1e-42a78b954598. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:57:32 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081 1073741824" returned: 0 in 0.703s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:32 devstack sudo[93288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081
Nov 03 16:57:32 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:32 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081" returned: 0 in 0.284s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:57:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7502701d-3ff7-4894-bfaa-3e6aad5d0ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d82027-6837-4844-a1c4-909fca2ed081', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23bf3cab-32d9-4131-83ae-f72a66d6177f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:32 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Volume volume-76d82027-6837-4844-a1c4-909fca2ed081 (76d82027-6837-4844-a1c4-909fca2ed081): created successfully
Nov 03 16:57:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23bf3cab-32d9-4131-83ae-f72a66d6177f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Flow 'volume_create_manager' (b4b7d46b-654f-4a13-b269-64da28b5db4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:57:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-f9bc20fc-9dcf-4bb6-ade2-5fa2d9b649f1 req-00e6d53f-80f7-41d3-ab29-8d78bab4e00a tempest-VolumesSnapshotsTestJSON-421701865 None] Created volume successfully.
Nov 03 16:57:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-88b015cc-016a-49e6-85f1-d5497e40c245 tempest-VolumesTransfersV357Test-1385841170 None] Transfer volume completed successfully.
Nov 03 16:57:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] Creating offline snapshot 1c01d0bd-085f-4f61-871f-f1ea21162178 of volume 76d82027-6837-4844-a1c4-909fca2ed081 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:57:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[508d3866-fedc-4e1a-97ad-2a97c0b91dc4]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:57:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:33 devstack sudo[93299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081
Nov 03 16:57:33 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-8a94e180-0767-45fe-8fc7-e11d64befd32 req-83ae7316-9e67-48a9-9aac-fbd647eeb8ac tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Acquiring lock "cinder-27dcb648-9078-41f2-9d3f-92e6101a104e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:57:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Lock "cinder-27dcb648-9078-41f2-9d3f-92e6101a104e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:57:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Acquiring lock "cinder-quobyte-27dcb648-9078-41f2-9d3f-92e6101a104e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Lock "cinder-quobyte-27dcb648-9078-41f2-9d3f-92e6101a104e" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87c308c-8502-4887-8779-d8d07f05deaa]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-27dcb648-9078-41f2-9d3f-92e6101a104e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:34 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081" returned: 0 in 0.474s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:34 devstack sudo[93305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178 1G
Nov 03 16:57:34 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:34 devstack sudo[93304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-27dcb648-9078-41f2-9d3f-92e6101a104e
Nov 03 16:57:34 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:34 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-27dcb648-9078-41f2-9d3f-92e6101a104e" returned: 0 in 0.404s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-27dcb648-9078-41f2-9d3f-92e6101a104e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:34 devstack sudo[93314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-27dcb648-9078-41f2-9d3f-92e6101a104e
Nov 03 16:57:34 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:34 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178 1G" returned: 0 in 0.482s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d82027-6837-4844-a1c4-909fca2ed081 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:34 devstack sudo[93317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d82027-6837-4844-a1c4-909fca2ed081 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178
Nov 03 16:57:34 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:34 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-27dcb648-9078-41f2-9d3f-92e6101a104e" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Lock "cinder-quobyte-27dcb648-9078-41f2-9d3f-92e6101a104e" released by "delete_volume" :: held 0.726s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Created reservations ['f7010108-e494-4e53-a719-e7d248ca439d', '8cdbd599-1369-457a-808e-3148a37837b2', 'cf272d34-e53e-4d87-a889-7e34cfbedba9', '49483f8c-6e50-43ec-804b-840a0532bbb3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:57:34 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d82027-6837-4844-a1c4-909fca2ed081 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178" returned: 0 in 0.302s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:34 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178 is being set with open permissions: ugo+rw
Nov 03 16:57:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:34 devstack sudo[93324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:57:34 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:34 devstack sudo[93325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178
Nov 03 16:57:34 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:35 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.276s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:57:35 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178" returned: 0 in 0.270s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Deleted volume successfully.
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-300de2ba-9efa-44c5-929c-2b3d7d90e603 tempest-VolumesTransfersV357Test-1437432260 None] Lock "cinder-27dcb648-9078-41f2-9d3f-92e6101a104e-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:35 devstack sudo[93332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.info
Nov 03 16:57:35 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:35 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.info" returned: 0 in 0.257s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:35 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.info is being set with open permissions: ugo+rw
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:35 devstack sudo[93335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.info
Nov 03 16:57:35 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Flow 'volume_create_manager' (74099066-e079-402c-87b3-d97d87031531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637b8aa0-f81f-470e-adbd-13583e6812f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:35 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.info" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-8a94e180-0767-45fe-8fc7-e11d64befd32 req-83ae7316-9e67-48a9-9aac-fbd647eeb8ac tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.936s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637b8aa0-f81f-470e-adbd-13583e6812f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-914673880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c01524-2342-4833-9327-5ef303c8327a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21451ec2551483c872dc2e9993420a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:36Z,use_quota=True,user_id='4b4939ad89d3404ca1fc0e09a884d402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc967a73-40dd-41ed-ab1b-886c070261f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc967a73-40dd-41ed-ab1b-886c070261f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57eff3be-ac25-47f4-a2bc-9628334779bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57eff3be-ac25-47f4-a2bc-9628334779bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c01524-2342-4833-9327-5ef303c8327a', 'volume_name': 'volume-09c01524-2342-4833-9327-5ef303c8327a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d384a68f-4c6d-4482-b2ec-0946935c0cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d384a68f-4c6d-4482-b2ec-0946935c0cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4395c2a-e0c2-4382-8b30-b23cfe51713f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:35 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Volume 09c01524-2342-4833-9327-5ef303c8327a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c01524-2342-4833-9327-5ef303c8327a', 'volume_size': 1}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-b58f8e5b-4c39-4718-81aa-dca081a88b1a req-3554f1e4-e0fd-432a-9d03-f4443c988520 tempest-VolumesSnapshotsTestJSON-421701865 None] Create snapshot completed successfully
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-8a94e180-0767-45fe-8fc7-e11d64befd32 req-83ae7316-9e67-48a9-9aac-fbd647eeb8ac tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.131s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.034s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-914673880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c01524-2342-4833-9327-5ef303c8327a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21451ec2551483c872dc2e9993420a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:36Z,use_quota=True,user_id='4b4939ad89d3404ca1fc0e09a884d402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Creating volume 09c01524-2342-4833-9327-5ef303c8327a {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:57:35 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-09c01524-2342-4833-9327-5ef303c8327a 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:35 devstack sudo[93339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-09c01524-2342-4833-9327-5ef303c8327a 1073741824
Nov 03 16:57:35 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-8a94e180-0767-45fe-8fc7-e11d64befd32 req-83ae7316-9e67-48a9-9aac-fbd647eeb8ac tempest-ServerActionsTestOtherA-1601141223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-33ad7443-2172-4460-9574-7e1ccad3bb6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '451b0277-f801-4662-9ae7-f73e6537dfce', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:57:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-8a94e180-0767-45fe-8fc7-e11d64befd32 req-83ae7316-9e67-48a9-9aac-fbd647eeb8ac tempest-ServerActionsTestOtherA-1601141223 None] attachment_update completed successfully.
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Acquiring lock "cinder-1c01d0bd-085f-4f61-871f-f1ea21162178-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "cinder-1c01d0bd-085f-4f61-871f-f1ea21162178-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Acquiring lock "cinder-quobyte-76d82027-6837-4844-a1c4-909fca2ed081" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "cinder-quobyte-76d82027-6837-4844-a1c4-909fca2ed081" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Acquiring lock "cinder-quobyte-1c01d0bd-085f-4f61-871f-f1ea21162178" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "cinder-quobyte-1c01d0bd-085f-4f61-871f-f1ea21162178" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Deleting offline snapshot 1c01d0bd-085f-4f61-871f-f1ea21162178 of volume 76d82027-6837-4844-a1c4-909fca2ed081 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] snapshot_file for this snap is: volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee4c61c-627c-4c3f-b033-ff33d54088be]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:36 devstack sudo[93344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178
Nov 03 16:57:36 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:36 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-09c01524-2342-4833-9327-5ef303c8327a 1073741824" returned: 0 in 0.580s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-09c01524-2342-4833-9327-5ef303c8327a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:36 devstack sudo[93425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-09c01524-2342-4833-9327-5ef303c8327a
Nov 03 16:57:36 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:36 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178" returned: 0 in 0.593s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76d82027-6837-4844-a1c4-909fca2ed081(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:57:36 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-09c01524-2342-4833-9327-5ef303c8327a" returned: 0 in 0.427s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b923bed-7874-47ff-acca-43ef1a46ad2c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4395c2a-e0c2-4382-8b30-b23cfe51713f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c01524-2342-4833-9327-5ef303c8327a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c24e67-b16b-4604-a8a7-430ee45fb1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:37 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Volume volume-09c01524-2342-4833-9327-5ef303c8327a (09c01524-2342-4833-9327-5ef303c8327a): created successfully
Nov 03 16:57:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c24e67-b16b-4604-a8a7-430ee45fb1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Flow 'volume_create_manager' (74099066-e079-402c-87b3-d97d87031531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:57:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2204bb88-1194-4a6b-84c9-54296fa63f93 tempest-VolumesTransfersV357Test-1572850446 None] Created volume successfully.
Nov 03 16:57:37 devstack sudo[93468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081
Nov 03 16:57:37 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:37 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081" returned: 0 in 0.639s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:37 devstack sudo[93811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178
Nov 03 16:57:37 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:38 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178" returned: 0 in 0.682s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:38 devstack sudo[93818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178
Nov 03 16:57:38 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Acquiring lock "cinder-09c01524-2342-4833-9327-5ef303c8327a-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:57:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Lock "cinder-09c01524-2342-4833-9327-5ef303c8327a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:57:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Acquiring lock "cinder-quobyte-09c01524-2342-4833-9327-5ef303c8327a" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:57:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Lock "cinder-quobyte-09c01524-2342-4833-9327-5ef303c8327a" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:57:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea2f644-a058-4fc7-a789-a401af2a8f51]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:57:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-09c01524-2342-4833-9327-5ef303c8327a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:38 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081.1c01d0bd-085f-4f61-871f-f1ea21162178" returned: 0 in 0.374s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:38 devstack sudo[93820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-09c01524-2342-4833-9327-5ef303c8327a
Nov 03 16:57:38 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "cinder-quobyte-1c01d0bd-085f-4f61-871f-f1ea21162178" released by "_delete_snapshot" :: held 2.507s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:57:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "cinder-quobyte-76d82027-6837-4844-a1c4-909fca2ed081" released by "delete_snapshot" :: held 2.541s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:57:38 devstack cinder-volume[87122]: DEBUG cinder.quota [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Created reservations ['a465e54f-151b-4a34-97c7-ff5543c0ecc7', 'f6363298-b792-4fdd-94d1-c3cae3d6aad8', '74055a20-0b7f-41ea-b2fb-1632ce4148db', '9cd1bbdd-ef86-4155-9625-081200349d3f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:57:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Delete snapshot completed successfully.
Nov 03 16:57:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-94223f5e-01a2-44ac-90f5-3172c32cd7d8 req-db6695fe-1d99-40e6-9e99-a9278a9e13a0 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "cinder-1c01d0bd-085f-4f61-871f-f1ea21162178-delete_snapshot" released by "delete_snapshot" :: held 2.922s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:57:39 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-09c01524-2342-4833-9327-5ef303c8327a" returned: 0 in 0.595s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-09c01524-2342-4833-9327-5ef303c8327a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:39 devstack sudo[93828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-09c01524-2342-4833-9327-5ef303c8327a
Nov 03 16:57:39 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:39 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-09c01524-2342-4833-9327-5ef303c8327a" returned: 0 in 0.435s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Lock "cinder-quobyte-09c01524-2342-4833-9327-5ef303c8327a" released by "delete_volume" :: held 1.115s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:57:39 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Created reservations ['5cafe63a-ee9f-457d-94b5-1e1c20841130', 'e394e3bd-07d7-4311-a331-1430db159320', '6fcb6411-ee8f-4c07-ab47-619140e5dab5', 'b523fddf-a55c-4a04-869b-1217f3faf048'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:57:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Acquiring lock "cinder-76d82027-6837-4844-a1c4-909fca2ed081-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:57:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "cinder-76d82027-6837-4844-a1c4-909fca2ed081-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:57:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Acquiring lock "cinder-quobyte-76d82027-6837-4844-a1c4-909fca2ed081" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:57:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "cinder-quobyte-76d82027-6837-4844-a1c4-909fca2ed081" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a37119-6f74-46cd-9923-12033a144693]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:40 devstack sudo[93832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:57:40 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:40 devstack sudo[93833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081
Nov 03 16:57:40 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:40 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:57:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Deleted volume successfully.
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-78a18555-912b-4f4b-8b15-5ead4d61255c tempest-VolumesTransfersV357Test-1437432260 None] Lock "cinder-09c01524-2342-4833-9327-5ef303c8327a-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:57:40 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081" returned: 0 in 0.447s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:40 devstack sudo[93841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081
Nov 03 16:57:40 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:40 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76d82027-6837-4844-a1c4-909fca2ed081" returned: 0 in 0.294s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "cinder-quobyte-76d82027-6837-4844-a1c4-909fca2ed081" released by "delete_volume" :: held 0.843s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:57:40 devstack cinder-volume[87122]: DEBUG cinder.quota [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Created reservations ['476b0d1e-e275-4443-a325-f0e2c9979731', '08454703-fd61-4df8-b3d0-ac12faf46336', '2df17983-faef-43dd-9d25-76cfd3a51fb7', '13fceed3-d3ed-41fd-93e3-f53b6df64166'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:57:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:57:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:57:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:41 devstack sudo[93844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:57:41 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:41 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.386s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:41 devstack cinder-volume[87122]: DEBUG cinder.manager [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:57:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Deleted volume successfully.
Nov 03 16:57:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-a6f1ba15-68ce-4236-93d7-b639ca491edb req-1e8e5f09-b2a4-445c-850f-a0069dcc1381 tempest-VolumesSnapshotsTestJSON-421701865 None] Lock "cinder-76d82027-6837-4844-a1c4-909fca2ed081-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:57:43 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:57:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Flow 'volume_create_manager' (88e9b3b2-c6b4-4ba1-ad44-eb3f1e85aef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:57:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4f4b77-5e56-4452-957b-9951b3caa4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4f4b77-5e56-4452-957b-9951b3caa4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-322223113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d9f09e-1582-4a0c-a366-0654e2e8f993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94128e38bf4060a676f41bb62316e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:44Z,use_quota=True,user_id='91a07d7932f5437eb03ef8df89296f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484fa14b-7272-44eb-8d41-0894ab1a07dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484fa14b-7272-44eb-8d41-0894ab1a07dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839a3e84-ed6b-4d9d-a043-29ef9c971880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839a3e84-ed6b-4d9d-a043-29ef9c971880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d9f09e-1582-4a0c-a366-0654e2e8f993', 'volume_name': 'volume-30d9f09e-1582-4a0c-a366-0654e2e8f993', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4216c4af-f0f0-4e0b-8cfe-078d82463914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4216c4af-f0f0-4e0b-8cfe-078d82463914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13a5a2c-184a-4609-b1d3-4fb7c67be21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:44 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Volume 30d9f09e-1582-4a0c-a366-0654e2e8f993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d9f09e-1582-4a0c-a366-0654e2e8f993', 'volume_size': 1}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-322223113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d9f09e-1582-4a0c-a366-0654e2e8f993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94128e38bf4060a676f41bb62316e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:44Z,use_quota=True,user_id='91a07d7932f5437eb03ef8df89296f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Creating volume 30d9f09e-1582-4a0c-a366-0654e2e8f993 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:57:44 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:57:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30d9f09e-1582-4a0c-a366-0654e2e8f993 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:44 devstack sudo[93852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30d9f09e-1582-4a0c-a366-0654e2e8f993 1073741824
Nov 03 16:57:44 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:45 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30d9f09e-1582-4a0c-a366-0654e2e8f993 1073741824" returned: 0 in 1.017s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30d9f09e-1582-4a0c-a366-0654e2e8f993 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:45 devstack sudo[93857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30d9f09e-1582-4a0c-a366-0654e2e8f993
Nov 03 16:57:45 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:45 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30d9f09e-1582-4a0c-a366-0654e2e8f993" returned: 0 in 0.541s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:57:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13a5a2c-184a-4609-b1d3-4fb7c67be21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d9f09e-1582-4a0c-a366-0654e2e8f993', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8378fe67-6240-43d5-87e2-d00056147ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:45 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Volume volume-30d9f09e-1582-4a0c-a366-0654e2e8f993 (30d9f09e-1582-4a0c-a366-0654e2e8f993): created successfully
Nov 03 16:57:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8378fe67-6240-43d5-87e2-d00056147ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Flow 'volume_create_manager' (88e9b3b2-c6b4-4ba1-ad44-eb3f1e85aef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:57:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-78b64c93-3799-47bb-9e0b-5bd4e6d43c0e tempest-AttachVolumeNegativeTest-920650290 None] Created volume successfully.
Nov 03 16:57:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-d1511831-609e-4a16-ace7-96ebf8bdb077 req-92a909c8-fcd4-4b20-8d14-a6cd1948f7f0 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-d1511831-609e-4a16-ace7-96ebf8bdb077 req-92a909c8-fcd4-4b20-8d14-a6cd1948f7f0 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-d1511831-609e-4a16-ace7-96ebf8bdb077 req-92a909c8-fcd4-4b20-8d14-a6cd1948f7f0 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-d1511831-609e-4a16-ace7-96ebf8bdb077 req-92a909c8-fcd4-4b20-8d14-a6cd1948f7f0 tempest-AttachVolumeNegativeTest-920650290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-30d9f09e-1582-4a0c-a366-0654e2e8f993', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf7a7faf-90e5-448a-8937-2eb76a53f8cb', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:57:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-d1511831-609e-4a16-ace7-96ebf8bdb077 req-92a909c8-fcd4-4b20-8d14-a6cd1948f7f0 tempest-AttachVolumeNegativeTest-920650290 None] attachment_update completed successfully.
Nov 03 16:57:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:57:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:57:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:57:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:51 devstack sudo[93879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:57:51 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Flow 'volume_create_manager' (da0584d6-a2c4-4e44-87b4-388fdf9d3d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e006845-f4ee-448c-afa7-0ba1cc0b6454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e006845-f4ee-448c-afa7-0ba1cc0b6454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-936132884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506aacf0-90be-416c-b1ae-523f556fda20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af9a90ca67e44829b1e7b77879811989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:52Z,use_quota=True,user_id='4feaa39e0ba94154b6f5c179b9baa606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa484c65-af9c-49be-b024-1b3cd360fc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa484c65-af9c-49be-b024-1b3cd360fc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b545c37d-0ddd-4ddd-bf67-84768702f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 16:57:52 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.532s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b545c37d-0ddd-4ddd-bf67-84768702f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '506aacf0-90be-416c-b1ae-523f556fda20', 'volume_name': 'volume-506aacf0-90be-416c-b1ae-523f556fda20', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e7244ce05c0>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b470379-92e7-4abc-aa8c-b71eb5cf0bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b470379-92e7-4abc-aa8c-b71eb5cf0bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a20d683-721a-49be-9a77-371adee9068d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:57:52 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Volume 506aacf0-90be-416c-b1ae-523f556fda20: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-506aacf0-90be-416c-b1ae-523f556fda20', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e7244ce05c0>}
Nov 03 16:57:52 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Trying to clone 506aacf0-90be-416c-b1ae-523f556fda20 from image 12ab4fb0-81c3-4967-9eea-39afb443d41b at location (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 16:57:53 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 16:57:53 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 16:57:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca789fc-eb4e-4a5a-a583-abd4d3ac283a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:57:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:53 devstack sudo[93883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD
Nov 03 16:57:53 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:53 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:53 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Temporary image 12ab4fb0-81c3-4967-9eea-39afb443d41b is fetched for user 4feaa39e0ba94154b6f5c179b9baa606. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 16:57:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c908f4-f79f-454b-bc88-ff5db743965b]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:57:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:54 devstack sudo[93889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD
Nov 03 16:57:54 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:54 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-936132884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506aacf0-90be-416c-b1ae-523f556fda20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af9a90ca67e44829b1e7b77879811989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:52Z,use_quota=True,user_id='4feaa39e0ba94154b6f5c179b9baa606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:57:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Creating volume 506aacf0-90be-416c-b1ae-523f556fda20 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:57:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:57:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:57:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:57:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:57:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:57:54 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:57:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:54 devstack sudo[93895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 1073741824
Nov 03 16:57:54 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:55 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 1073741824" returned: 0 in 0.675s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:55 devstack sudo[93901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20
Nov 03 16:57:55 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:55 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20" returned: 0 in 0.368s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:57:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:57:55 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Attempting download of 12ab4fb0-81c3-4967-9eea-39afb443d41b ((None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}])) to volume 506aacf0-90be-416c-b1ae-523f556fda20. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 16:57:55 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0674025a-afa8-4c25-8fd6-e15065db13d5]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:57:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_hs3hr9oh {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:55 devstack sudo[93907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_hs3hr9oh
Nov 03 16:57:55 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:56 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_hs3hr9oh" returned: 0 in 0.409s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_hs3hr9oh {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:56 devstack sudo[93915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_hs3hr9oh
Nov 03 16:57:56 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:56 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_hs3hr9oh" returned: 1 in 0.449s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_hs3hr9oh' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:57:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a3be14-f73a-4b5c-987a-12e1550a1b5e]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:57:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:56 devstack sudo[93943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD
Nov 03 16:57:56 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:57 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root
Nov 03 16:57:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:57:57 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] 12ab4fb0-81c3-4967-9eea-39afb443d41b was qcow2, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 16:57:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:57:57 devstack sudo[93949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20
Nov 03 16:57:57 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:57:59 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20" returned: 0 in 2.902s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:00 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_pmpf87evdevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:58:00 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Converted 112.00 MB image at 38.56 MB/s
Nov 03 16:58:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:00 devstack sudo[93978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 1G
Nov 03 16:58:00 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:00 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 1G" returned: 0 in 0.483s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:00 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Downloaded image 12ab4fb0-81c3-4967-9eea-39afb443d41b ((None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}])) to volume 506aacf0-90be-416c-b1ae-523f556fda20 successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 16:58:00 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Temporary image 12ab4fb0-81c3-4967-9eea-39afb443d41b for user 4feaa39e0ba94154b6f5c179b9baa606 is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 16:58:00 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Marking volume 506aacf0-90be-416c-b1ae-523f556fda20 as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 16:58:00 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Copying metadata from image 12ab4fb0-81c3-4967-9eea-39afb443d41b to 506aacf0-90be-416c-b1ae-523f556fda20. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 16:58:00 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Creating volume glance metadata for volume 506aacf0-90be-416c-b1ae-523f556fda20 backed by image 12ab4fb0-81c3-4967-9eea-39afb443d41b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 16:58:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a20d683-721a-49be-9a77-371adee9068d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-506aacf0-90be-416c-b1ae-523f556fda20', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e7244ce05c0>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15defc1-f0d6-45d8-afa5-26eeaea8186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:00 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Volume volume-506aacf0-90be-416c-b1ae-523f556fda20 (506aacf0-90be-416c-b1ae-523f556fda20): created successfully
Nov 03 16:58:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15defc1-f0d6-45d8-afa5-26eeaea8186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Flow 'volume_create_manager' (da0584d6-a2c4-4e44-87b4-388fdf9d3d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:58:00 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-02b8a55f-b163-4520-917e-e20e96b22cff tempest-VolumesExtendTest-209061012 None] Created volume successfully.
Nov 03 16:58:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0871ce05-1501-4e73-b7e2-77a5d7efbdc4 tempest-VolumesExtendTest-209061012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0871ce05-1501-4e73-b7e2-77a5d7efbdc4 tempest-VolumesExtendTest-209061012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:01 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c4e476-e385-4f1d-8fb7-cc79653341b4]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0871ce05-1501-4e73-b7e2-77a5d7efbdc4 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:01 devstack sudo[93985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20
Nov 03 16:58:01 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:01 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0871ce05-1501-4e73-b7e2-77a5d7efbdc4 tempest-VolumesExtendTest-209061012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20" returned: 0 in 0.722s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0871ce05-1501-4e73-b7e2-77a5d7efbdc4 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 2G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0871ce05-1501-4e73-b7e2-77a5d7efbdc4 tempest-VolumesExtendTest-209061012 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 2G" returned: 0 in 0.169s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0871ce05-1501-4e73-b7e2-77a5d7efbdc4 tempest-VolumesExtendTest-209061012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.932s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0871ce05-1501-4e73-b7e2-77a5d7efbdc4 tempest-VolumesExtendTest-209061012 None] Extend volume completed successfully.
Nov 03 16:58:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Acquiring lock "cinder-506aacf0-90be-416c-b1ae-523f556fda20-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Lock "cinder-506aacf0-90be-416c-b1ae-523f556fda20-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Acquiring lock "cinder-quobyte-506aacf0-90be-416c-b1ae-523f556fda20" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Lock "cinder-quobyte-506aacf0-90be-416c-b1ae-523f556fda20" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc7f58b-2a18-4bd0-8333-f8d3b1eeba3c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:03 devstack sudo[94038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20
Nov 03 16:58:03 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:03 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20" returned: 0 in 0.593s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:03 devstack sudo[94043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20
Nov 03 16:58:03 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:03 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-506aacf0-90be-416c-b1ae-523f556fda20" returned: 0 in 0.384s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Lock "cinder-quobyte-506aacf0-90be-416c-b1ae-523f556fda20" released by "delete_volume" :: held 1.079s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:04 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Created reservations ['8c5cf976-64ae-4a85-baf9-ee45c63a69cb', 'f7b69277-aadc-447d-bbec-19c8a0805886', 'c3f3e611-73a6-4660-95f9-e7d81f049563', '4969a187-b85d-4b5f-ba2b-41af7e726856'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:58:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:58:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:58:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:04 devstack sudo[94046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:58:04 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:04 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.521s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:04 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:58:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Deleted volume successfully.
Nov 03 16:58:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c8be7f34-b125-403b-884a-101876364d73 tempest-VolumesExtendTest-209061012 None] Lock "cinder-506aacf0-90be-416c-b1ae-523f556fda20-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Flow 'volume_create_manager' (18f80815-31c9-4f9d-8cdd-180bc94063a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1c6974-ae42-417a-9c94-fcdbfa867d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1c6974-ae42-417a-9c94-fcdbfa867d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1405438354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f756183c-8df6-4628-8eb1-e27354c665fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af9a90ca67e44829b1e7b77879811989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:06Z,use_quota=True,user_id='4feaa39e0ba94154b6f5c179b9baa606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986b84a5-fa02-45f3-a3eb-199725a246c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986b84a5-fa02-45f3-a3eb-199725a246c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18700d7d-6fa8-4b92-8d3e-d0b241c8895b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18700d7d-6fa8-4b92-8d3e-d0b241c8895b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f756183c-8df6-4628-8eb1-e27354c665fb', 'volume_name': 'volume-f756183c-8df6-4628-8eb1-e27354c665fb', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc41925-464b-4865-aa3f-4c2d6b471019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc41925-464b-4865-aa3f-4c2d6b471019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd52a09d-470d-4124-a76a-616797d9e72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Volume f756183c-8df6-4628-8eb1-e27354c665fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f756183c-8df6-4628-8eb1-e27354c665fb', 'volume_size': 1}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1405438354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f756183c-8df6-4628-8eb1-e27354c665fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af9a90ca67e44829b1e7b77879811989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:06Z,use_quota=True,user_id='4feaa39e0ba94154b6f5c179b9baa606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Creating volume f756183c-8df6-4628-8eb1-e27354c665fb {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:58:06 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:58:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:06 devstack sudo[94084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb 1073741824
Nov 03 16:58:06 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:07 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb 1073741824" returned: 0 in 0.817s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:07 devstack sudo[94103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb
Nov 03 16:58:07 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:07 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb" returned: 0 in 0.578s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:58:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd52a09d-470d-4124-a76a-616797d9e72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f756183c-8df6-4628-8eb1-e27354c665fb', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4ee2b7-3068-4e57-bc54-003cb33938af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:08 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Volume volume-f756183c-8df6-4628-8eb1-e27354c665fb (f756183c-8df6-4628-8eb1-e27354c665fb): created successfully
Nov 03 16:58:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4ee2b7-3068-4e57-bc54-003cb33938af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Flow 'volume_create_manager' (18f80815-31c9-4f9d-8cdd-180bc94063a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:58:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5243da9e-56f5-40e8-a9cd-f5502e3ea488 tempest-VolumesExtendTest-209061012 None] Created volume successfully.
Nov 03 16:58:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] Creating offline snapshot c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 of volume f756183c-8df6-4628-8eb1-e27354c665fb {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:58:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[711b9186-1acb-462f-8414-647ef1078bcd]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:09 devstack sudo[94136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb
Nov 03 16:58:09 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:09 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb" returned: 0 in 0.723s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:09 devstack sudo[94144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 1G
Nov 03 16:58:09 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:58:10 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Flow 'volume_create_manager' (1da9a2c3-33eb-4b23-9cd0-104a2ed6e4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554fb62e-50fc-4598-9fec-fe21f5919e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 1G" returned: 0 in 0.750s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f756183c-8df6-4628-8eb1-e27354c665fb -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554fb62e-50fc-4598-9fec-fe21f5919e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-348376637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f42fb5-e6b0-401d-9d44-c7e8411cef5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13fe7e3a17504d658a013830208188f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:11Z,use_quota=True,user_id='ac071e87f7bc48c39f6abbb2325dfa95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:10 devstack sudo[94153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f756183c-8df6-4628-8eb1-e27354c665fb -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ce762d-d374-4cee-aae2-be0cbce2d5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:10 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ce762d-d374-4cee-aae2-be0cbce2d5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04eb2e07-6dd5-4a94-a224-d29381f16b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04eb2e07-6dd5-4a94-a224-d29381f16b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10f42fb5-e6b0-401d-9d44-c7e8411cef5f', 'volume_name': 'volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd91fa0-1b20-41ef-b9c3-bc5c0c30fec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd91fa0-1b20-41ef-b9c3-bc5c0c30fec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b3fc49-b33d-498d-a90a-57453407882a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:10 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Volume 10f42fb5-e6b0-401d-9d44-c7e8411cef5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f', 'volume_size': 1}
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:10 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-ae6c6e77-6a8c-47f5-8f31-e00bcfd4f318 tempest-ServerActionsTestOtherA-1601141223 None] Terminate volume connection completed successfully.
Nov 03 16:58:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-ae6c6e77-6a8c-47f5-8f31-e00bcfd4f318 tempest-ServerActionsTestOtherA-1601141223 None] Deleting attachment 451b0277-f801-4662-9ae7-f73e6537dfce. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:58:11 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f756183c-8df6-4628-8eb1-e27354c665fb -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36" returned: 0 in 0.407s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:11 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 is being set with open permissions: ugo+rw
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:11 devstack sudo[94160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36
Nov 03 16:58:11 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "cinder-33ad7443-2172-4460-9574-7e1ccad3bb6e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Lock "cinder-33ad7443-2172-4460-9574-7e1ccad3bb6e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "cinder-quobyte-33ad7443-2172-4460-9574-7e1ccad3bb6e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Lock "cinder-quobyte-33ad7443-2172-4460-9574-7e1ccad3bb6e" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f0fad7-8623-4b05-b8c9-fed12e2be514]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:11 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36" returned: 0 in 0.557s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:11 devstack sudo[94162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e
Nov 03 16:58:11 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:11 devstack sudo[94165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.info
Nov 03 16:58:11 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:11 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e" returned: 0 in 0.542s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:11 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:11 devstack sudo[94171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.info" returned: 0 in 0.298s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:11 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:11 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.info is being set with open permissions: ugo+rw
Nov 03 16:58:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:11 devstack sudo[94173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.info
Nov 03 16:58:11 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:12 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-33ad7443-2172-4460-9574-7e1ccad3bb6e" returned: 0 in 0.256s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Lock "cinder-quobyte-33ad7443-2172-4460-9574-7e1ccad3bb6e" released by "delete_volume" :: held 0.886s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:12 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.info" returned: 0 in 0.284s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.218s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.568s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-348376637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f42fb5-e6b0-401d-9d44-c7e8411cef5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13fe7e3a17504d658a013830208188f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:11Z,use_quota=True,user_id='ac071e87f7bc48c39f6abbb2325dfa95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Creating volume 10f42fb5-e6b0-401d-9d44-c7e8411cef5f {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:58:12 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:12 devstack sudo[94177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f 1073741824
Nov 03 16:58:12 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.quota [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Created reservations ['e30c18d3-7fd8-47c2-b923-1514205b3925', '52a8c483-0b39-458f-a503-1ef648bf76f8', '2c122e0e-f1e5-4471-9ae8-14abbfa217be', '98e175af-8463-40be-96e8-d803673f45df'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:58:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-698e8ca4-7e28-4eb0-ba5e-1ea605410c83 tempest-VolumesExtendTest-209061012 None] Create snapshot completed successfully
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:12 devstack sudo[94179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:58:12 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "cinder-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Lock "cinder-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:12 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.390s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.manager [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "cinder-quobyte-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Deleted volume successfully.
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Lock "cinder-quobyte-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-166a7a5a-1561-4cbd-9ee4-58cc2328d52b req-609281cc-7d68-41a7-b330-252b9b44ab72 tempest-ServerActionsTestOtherA-1601141223 None] Lock "cinder-33ad7443-2172-4460-9574-7e1ccad3bb6e-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb08694-189a-4d84-817d-bd51760442c3]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:12 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f 1073741824" returned: 0 in 0.596s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:12 devstack sudo[94187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f
Nov 03 16:58:12 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:12 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0
Nov 03 16:58:12 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:13 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f" returned: 0 in 0.260s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b3fc49-b33d-498d-a90a-57453407882a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae1302d-dd2b-493d-bfba-6e83e8c1883a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:13 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Volume volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f (10f42fb5-e6b0-401d-9d44-c7e8411cef5f): created successfully
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae1302d-dd2b-493d-bfba-6e83e8c1883a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Flow 'volume_create_manager' (1da9a2c3-33eb-4b23-9cd0-104a2ed6e4a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:58:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bc98e7ce-a21f-4713-a96b-90217b9c5e84 tempest-VolumesServicesTestJSON-423149513 None] Created volume successfully.
Nov 03 16:58:13 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0" returned: 0 in 0.437s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:13 devstack sudo[94194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0
Nov 03 16:58:13 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0609b012-4e9a-4b3d-b327-dc936f32f034 tempest-VolumesExtendTest-209061012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0609b012-4e9a-4b3d-b327-dc936f32f034 tempest-VolumesExtendTest-209061012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb952f3-5b02-4a84-9b16-0f0b6899a8d4]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0609b012-4e9a-4b3d-b327-dc936f32f034 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:13 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0" returned: 0 in 0.281s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Lock "cinder-quobyte-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0" released by "delete_volume" :: held 0.771s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:13 devstack sudo[94196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb
Nov 03 16:58:13 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Created reservations ['dd17a0e6-2960-48c5-b74b-1d8050109af6', 'afe1fb82-e455-4218-812d-f357da67cf20', 'a5e967fe-343d-4239-b3bb-ef1e5a467e93', '3655394d-db6c-4399-81b2-7c118b529699'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:13 devstack sudo[94199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:58:13 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:14 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0609b012-4e9a-4b3d-b327-dc936f32f034 tempest-VolumesExtendTest-209061012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb" returned: 0 in 0.534s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0609b012-4e9a-4b3d-b327-dc936f32f034 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 2G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Acquiring lock "cinder-10f42fb5-e6b0-401d-9d44-c7e8411cef5f-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:14 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.489s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Lock "cinder-10f42fb5-e6b0-401d-9d44-c7e8411cef5f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Deleted volume successfully.
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fb61ceca-642c-48c9-8ce7-c6b1ea5d7ac4 tempest-ServerActionsTestOtherA-1601141223 None] Lock "cinder-e70a8679-fcb5-46c8-b3cf-e6d8b6644cd0-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Acquiring lock "cinder-quobyte-10f42fb5-e6b0-401d-9d44-c7e8411cef5f" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Lock "cinder-quobyte-10f42fb5-e6b0-401d-9d44-c7e8411cef5f" acquired by "delete_volume" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0609b012-4e9a-4b3d-b327-dc936f32f034 tempest-VolumesExtendTest-209061012 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 2G" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0609b012-4e9a-4b3d-b327-dc936f32f034 tempest-VolumesExtendTest-209061012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.915s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf5f485-3e1e-48b3-8a5a-7cb8e4ca191f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0609b012-4e9a-4b3d-b327-dc936f32f034 tempest-VolumesExtendTest-209061012 None] Extend volume completed successfully.
Nov 03 16:58:14 devstack sudo[94212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f
Nov 03 16:58:14 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:14 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f" returned: 0 in 0.519s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:14 devstack sudo[94236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f
Nov 03 16:58:14 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Acquiring lock "cinder-c81c5233-bf05-4f82-9d69-2b1ab0f3fd36-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Lock "cinder-c81c5233-bf05-4f82-9d69-2b1ab0f3fd36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Acquiring lock "cinder-quobyte-f756183c-8df6-4628-8eb1-e27354c665fb" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Lock "cinder-quobyte-f756183c-8df6-4628-8eb1-e27354c665fb" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Acquiring lock "cinder-quobyte-c81c5233-bf05-4f82-9d69-2b1ab0f3fd36" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Lock "cinder-quobyte-c81c5233-bf05-4f82-9d69-2b1ab0f3fd36" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Deleting offline snapshot c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 of volume f756183c-8df6-4628-8eb1-e27354c665fb {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] snapshot_file for this snap is: volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c23f817-7562-4de4-85b2-50f3077ad0c0]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:15 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10f42fb5-e6b0-401d-9d44-c7e8411cef5f" returned: 0 in 0.511s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Lock "cinder-quobyte-10f42fb5-e6b0-401d-9d44-c7e8411cef5f" released by "delete_volume" :: held 1.097s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:15 devstack sudo[94239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36
Nov 03 16:58:15 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Created reservations ['4dc44678-a4a4-4bf3-922c-9d6804243667', '9c1635c5-8496-46b8-89c8-f7b3daa06e49', 'c02ee520-6f30-4627-b1e6-e3aa4dde07e8', 'b65e1064-32a4-4df4-a420-7563862db7cf'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:16 devstack sudo[94249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:58:16 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:16 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36" returned: 0 in 1.058s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f756183c-8df6-4628-8eb1-e27354c665fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:58:16 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[54048d0b-26b6-45d9-b7e5-99e3914b8172]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:16 devstack sudo[94264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb
Nov 03 16:58:16 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:16 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.712s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:16 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:58:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Deleted volume successfully.
Nov 03 16:58:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20173e41-3ac4-490a-b391-c6256af7b36a tempest-VolumesServicesTestJSON-423149513 None] Lock "cinder-10f42fb5-e6b0-401d-9d44-c7e8411cef5f-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:17 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb" returned: 0 in 0.776s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:17 devstack sudo[94289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36
Nov 03 16:58:17 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:17 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36" returned: 0 in 0.670s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:17 devstack sudo[94294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36
Nov 03 16:58:17 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:18 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb.c81c5233-bf05-4f82-9d69-2b1ab0f3fd36" returned: 0 in 0.294s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Lock "cinder-quobyte-c81c5233-bf05-4f82-9d69-2b1ab0f3fd36" released by "_delete_snapshot" :: held 3.007s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Lock "cinder-quobyte-f756183c-8df6-4628-8eb1-e27354c665fb" released by "delete_snapshot" :: held 3.047s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:18 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Created reservations ['5c2f871b-e4e8-4399-a4c9-910b15eb4999', '20518637-d9f8-4e8b-b45b-ee2d38275876', 'c21db90a-b375-471b-b58c-78d38494e619', '33b87886-f9dc-49ee-89b3-c26a87aa98f0'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:58:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Delete snapshot completed successfully.
Nov 03 16:58:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab39f7fc-7365-4bdc-a2b5-16ce74015274 tempest-VolumesExtendTest-209061012 None] Lock "cinder-c81c5233-bf05-4f82-9d69-2b1ab0f3fd36-delete_snapshot" released by "delete_snapshot" :: held 3.239s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Acquiring lock "cinder-f756183c-8df6-4628-8eb1-e27354c665fb-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Lock "cinder-f756183c-8df6-4628-8eb1-e27354c665fb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Acquiring lock "cinder-quobyte-f756183c-8df6-4628-8eb1-e27354c665fb" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Lock "cinder-quobyte-f756183c-8df6-4628-8eb1-e27354c665fb" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b47c5cf-cbb1-48ea-9398-39af05ee05b4]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:18 devstack sudo[94297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb
Nov 03 16:58:18 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:19 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb" returned: 0 in 0.446s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:19 devstack sudo[94302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb
Nov 03 16:58:19 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:19 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f756183c-8df6-4628-8eb1-e27354c665fb" returned: 0 in 0.295s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Lock "cinder-quobyte-f756183c-8df6-4628-8eb1-e27354c665fb" released by "delete_volume" :: held 0.852s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Created reservations ['73dfb804-21c0-4330-9551-697b50be1be1', '6ae12a72-234f-4a37-a3c0-0b1268105e35', 'fea1518c-e6a5-4016-a493-e92ed070a728', '4a734766-ef44-4349-bd88-f367a33e578e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:19 devstack sudo[94305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:58:19 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:19 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.295s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:58:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Deleted volume successfully.
Nov 03 16:58:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cdf4cf6-6c17-4377-a89f-37d2f60a4907 tempest-VolumesExtendTest-209061012 None] Lock "cinder-f756183c-8df6-4628-8eb1-e27354c665fb-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:29 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=101,cinder:SELECT=97,cinder:INSERT=36,cinder:DELETE=8 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:58:29 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=100,cinder:UPDATE=117,cinder:DELETE=9,cinder:INSERT=26 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Flow 'volume_create_manager' (0c0474b4-c055-4e52-a5d8-da7041819652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91807e50-abcf-458a-8b1e-e0a5999df756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91807e50-abcf-458a-8b1e-e0a5999df756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-139263718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc1b9af-e65a-410f-8667-aaf3e642c728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d423f7ad2bc44a6e868fa5497e6fe6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:38Z,use_quota=True,user_id='03e594c1c7704695871bb157f6616f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451ba1db-a277-4273-a360-f7afa6503fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451ba1db-a277-4273-a360-f7afa6503fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584b257a-c0f6-4642-bfef-059f953b35b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584b257a-c0f6-4642-bfef-059f953b35b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc1b9af-e65a-410f-8667-aaf3e642c728', 'volume_name': 'volume-cfc1b9af-e65a-410f-8667-aaf3e642c728', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20cb184d-ca33-4c2a-a5e6-d876dfd3ec52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20cb184d-ca33-4c2a-a5e6-d876dfd3ec52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1787042-1395-478c-8124-a91d4b29cb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:38 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Volume cfc1b9af-e65a-410f-8667-aaf3e642c728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc1b9af-e65a-410f-8667-aaf3e642c728', 'volume_size': 1}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-139263718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc1b9af-e65a-410f-8667-aaf3e642c728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d423f7ad2bc44a6e868fa5497e6fe6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:38Z,use_quota=True,user_id='03e594c1c7704695871bb157f6616f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Creating volume cfc1b9af-e65a-410f-8667-aaf3e642c728 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:58:38 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:58:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:38 devstack sudo[94356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728 1073741824
Nov 03 16:58:38 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:39 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728 1073741824" returned: 0 in 0.555s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:39 devstack sudo[94363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728
Nov 03 16:58:39 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:39 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728" returned: 0 in 0.303s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:58:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1787042-1395-478c-8124-a91d4b29cb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc1b9af-e65a-410f-8667-aaf3e642c728', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6822b07-84a0-46bc-8bff-01c95e1e538f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Volume volume-cfc1b9af-e65a-410f-8667-aaf3e642c728 (cfc1b9af-e65a-410f-8667-aaf3e642c728): created successfully
Nov 03 16:58:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6822b07-84a0-46bc-8bff-01c95e1e538f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Flow 'volume_create_manager' (0c0474b4-c055-4e52-a5d8-da7041819652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:58:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-432ac8cd-c285-485d-86b2-07a9915aa18c tempest-VolumesSnapshotTestJSON-120910895 None] Created volume successfully.
Nov 03 16:58:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-e429d425-ddd7-4711-905d-18177ca1ce5f req-4825e39f-27d6-4b59-be5a-3507be4f0c64 tempest-AttachVolumeNegativeTest-920650290 None] Terminate volume connection completed successfully.
Nov 03 16:58:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-e429d425-ddd7-4711-905d-18177ca1ce5f req-4825e39f-27d6-4b59-be5a-3507be4f0c64 tempest-AttachVolumeNegativeTest-920650290 None] Deleting attachment bf7a7faf-90e5-448a-8937-2eb76a53f8cb. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:58:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] Creating offline snapshot 6bfae09d-7bc9-4427-8c13-312f4c75af31 of volume cfc1b9af-e65a-410f-8667-aaf3e642c728 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:58:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9c4670-fa45-4e97-a8f0-ca06baa386ba]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:42 devstack sudo[94392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728
Nov 03 16:58:42 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:42 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728" returned: 0 in 0.720s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:42 devstack sudo[94398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31 1G
Nov 03 16:58:42 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:43 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31 1G" returned: 0 in 0.789s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc1b9af-e65a-410f-8667-aaf3e642c728 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:43 devstack sudo[94408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc1b9af-e65a-410f-8667-aaf3e642c728 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31
Nov 03 16:58:43 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:43 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc1b9af-e65a-410f-8667-aaf3e642c728 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31" returned: 0 in 0.461s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:43 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31 is being set with open permissions: ugo+rw
Nov 03 16:58:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:43 devstack sudo[94414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31
Nov 03 16:58:43 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:44 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31" returned: 0 in 0.296s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:44 devstack sudo[94417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.info
Nov 03 16:58:44 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:44 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.info" returned: 0 in 0.340s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:44 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.info is being set with open permissions: ugo+rw
Nov 03 16:58:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:44 devstack sudo[94420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.info
Nov 03 16:58:44 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:45 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.info" returned: 0 in 0.454s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.323s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-db228d69-6953-4eee-b09d-aeaad74dfe8f tempest-VolumesSnapshotTestJSON-120910895 None] Create snapshot completed successfully
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-6bfae09d-7bc9-4427-8c13-312f4c75af31-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-6bfae09d-7bc9-4427-8c13-312f4c75af31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-cfc1b9af-e65a-410f-8667-aaf3e642c728" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-cfc1b9af-e65a-410f-8667-aaf3e642c728" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-6bfae09d-7bc9-4427-8c13-312f4c75af31" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-6bfae09d-7bc9-4427-8c13-312f4c75af31" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Deleting offline snapshot 6bfae09d-7bc9-4427-8c13-312f4c75af31 of volume cfc1b9af-e65a-410f-8667-aaf3e642c728 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] snapshot_file for this snap is: volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4234d8-5753-4456-a6d9-47d3be2bd95f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:46 devstack sudo[94424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31
Nov 03 16:58:46 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:46 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31" returned: 0 in 0.430s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfc1b9af-e65a-410f-8667-aaf3e642c728(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b5285a-8c3b-43ff-a5fb-f535b947d4a6]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:47 devstack sudo[94429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728
Nov 03 16:58:47 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:47 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728" returned: 0 in 0.413s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:47 devstack sudo[94434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31
Nov 03 16:58:47 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:47 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31" returned: 0 in 0.390s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:47 devstack sudo[94440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31
Nov 03 16:58:47 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:48 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728.6bfae09d-7bc9-4427-8c13-312f4c75af31" returned: 0 in 0.352s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-6bfae09d-7bc9-4427-8c13-312f4c75af31" released by "_delete_snapshot" :: held 1.743s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-cfc1b9af-e65a-410f-8667-aaf3e642c728" released by "delete_snapshot" :: held 1.772s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:48 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Created reservations ['5fb507b4-aae7-483b-acbe-aab044521da7', '4d3a4115-452b-41ea-81bc-f8bce84e191f', '97f505fc-1c18-4cda-b407-9fa645b8de47', 'f1cdf863-80a0-47ee-aa30-8cb016acd87f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:58:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Delete snapshot completed successfully.
Nov 03 16:58:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4909308-24e6-4049-a1c5-47d191371904 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-6bfae09d-7bc9-4427-8c13-312f4c75af31-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Flow 'volume_create_manager' (6486ff61-1bca-45e8-b87c-927bb203f87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc674e6-d4f1-4cce-bbba-c0030a7f3642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc674e6-d4f1-4cce-bbba-c0030a7f3642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-246839887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb255e5-ab63-4f23-953d-6d162da9f20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d423f7ad2bc44a6e868fa5497e6fe6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:49Z,use_quota=True,user_id='03e594c1c7704695871bb157f6616f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef69156-3f43-4348-a49f-92ef881f909e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef69156-3f43-4348-a49f-92ef881f909e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13b4b46-e61d-4962-8183-b01833adf354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13b4b46-e61d-4962-8183-b01833adf354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb255e5-ab63-4f23-953d-6d162da9f20e', 'volume_name': 'volume-0cb255e5-ab63-4f23-953d-6d162da9f20e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112d8cba-3f3b-475c-8a9e-bc9ae133b337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112d8cba-3f3b-475c-8a9e-bc9ae133b337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde02c71-71ea-4650-bfe8-b99b50e2624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:49 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Volume 0cb255e5-ab63-4f23-953d-6d162da9f20e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb255e5-ab63-4f23-953d-6d162da9f20e', 'volume_size': 1}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-246839887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb255e5-ab63-4f23-953d-6d162da9f20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d423f7ad2bc44a6e868fa5497e6fe6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:49Z,use_quota=True,user_id='03e594c1c7704695871bb157f6616f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Creating volume 0cb255e5-ab63-4f23-953d-6d162da9f20e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:58:49 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:49 devstack sudo[94443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e 1073741824
Nov 03 16:58:49 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:49 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e 1073741824" returned: 0 in 0.625s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:50 devstack sudo[94452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e
Nov 03 16:58:50 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:50 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e" returned: 0 in 0.335s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:58:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde02c71-71ea-4650-bfe8-b99b50e2624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb255e5-ab63-4f23-953d-6d162da9f20e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18da3c3-8c06-4bae-8830-14a2b06984e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:50 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Volume volume-0cb255e5-ab63-4f23-953d-6d162da9f20e (0cb255e5-ab63-4f23-953d-6d162da9f20e): created successfully
Nov 03 16:58:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18da3c3-8c06-4bae-8830-14a2b06984e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Flow 'volume_create_manager' (6486ff61-1bca-45e8-b87c-927bb203f87e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:58:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4a749efc-c403-438a-9cb9-1fb4f3a3ca35 tempest-VolumesSnapshotTestJSON-120910895 None] Created volume successfully.
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:58:51 devstack sudo[94463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:58:51 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Flow 'volume_create_manager' (fdd7a136-a622-4844-8617-0928fd28f2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6c0aea-2718-4dce-bfcc-8eced6f2d202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] Creating offline snapshot 184e4373-c0ec-414d-bb53-16af9442b9aa of volume 0cb255e5-ab63-4f23-953d-6d162da9f20e {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:58:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6c0aea-2718-4dce-bfcc-8eced6f2d202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-545976014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c65d303-d747-4ed8-a00c-72b531606a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a52ee2d14346c2bda00553bcbd8260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:52Z,use_quota=True,user_id='23583463fa57483fa0b8a932b4b33f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f41a769-a8ed-4643-a4a5-c25d05698dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f41a769-a8ed-4643-a4a5-c25d05698dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829e36d3-8c58-4e6a-a4af-1eea41c6f3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829e36d3-8c58-4e6a-a4af-1eea41c6f3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c65d303-d747-4ed8-a00c-72b531606a8f', 'volume_name': 'volume-8c65d303-d747-4ed8-a00c-72b531606a8f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf8c776-8c1c-48f9-84f5-88812e6c630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf8c776-8c1c-48f9-84f5-88812e6c630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52531ed-9c4d-4f77-a736-3f04e2e7700d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:52 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Volume 8c65d303-d747-4ed8-a00c-72b531606a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c65d303-d747-4ed8-a00c-72b531606a8f', 'volume_size': 1}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc2df78-ca81-4578-be44-2e49b98b3d9d]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:52 devstack sudo[94473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e
Nov 03 16:58:52 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:52 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.432s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:58:52 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e" returned: 0 in 0.555s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:52 devstack sudo[94487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa 1G
Nov 03 16:58:52 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:53 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa 1G" returned: 0 in 0.503s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cb255e5-ab63-4f23-953d-6d162da9f20e -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:53 devstack sudo[94493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cb255e5-ab63-4f23-953d-6d162da9f20e -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa
Nov 03 16:58:53 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:53 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cb255e5-ab63-4f23-953d-6d162da9f20e -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa" returned: 0 in 0.378s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:53 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa is being set with open permissions: ugo+rw
Nov 03 16:58:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:53 devstack sudo[94498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa
Nov 03 16:58:53 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:53 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa" returned: 0 in 0.324s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:53 devstack sudo[94503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.info
Nov 03 16:58:53 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:54 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.info" returned: 0 in 0.366s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:54 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.info is being set with open permissions: ugo+rw
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:54 devstack sudo[94514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.info
Nov 03 16:58:54 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:54 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.info" returned: 0 in 0.328s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.728s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.551s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-545976014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c65d303-d747-4ed8-a00c-72b531606a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a52ee2d14346c2bda00553bcbd8260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:52Z,use_quota=True,user_id='23583463fa57483fa0b8a932b4b33f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Creating volume 8c65d303-d747-4ed8-a00c-72b531606a8f {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:58:54 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:58:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8c65d303-d747-4ed8-a00c-72b531606a8f 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:54 devstack sudo[94523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8c65d303-d747-4ed8-a00c-72b531606a8f 1073741824
Nov 03 16:58:54 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-feeb77e7-11d2-4e40-b966-8cc09a39c3fc tempest-VolumesSnapshotTestJSON-120910895 None] Create snapshot completed successfully
Nov 03 16:58:55 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8c65d303-d747-4ed8-a00c-72b531606a8f 1073741824" returned: 0 in 0.994s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8c65d303-d747-4ed8-a00c-72b531606a8f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:55 devstack sudo[94586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8c65d303-d747-4ed8-a00c-72b531606a8f
Nov 03 16:58:55 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:56 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8c65d303-d747-4ed8-a00c-72b531606a8f" returned: 0 in 0.597s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52531ed-9c4d-4f77-a736-3f04e2e7700d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c65d303-d747-4ed8-a00c-72b531606a8f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21fdf00-22e6-45d9-be34-9a710f9cb7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:56 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Volume volume-8c65d303-d747-4ed8-a00c-72b531606a8f (8c65d303-d747-4ed8-a00c-72b531606a8f): created successfully
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21fdf00-22e6-45d9-be34-9a710f9cb7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Flow 'volume_create_manager' (fdd7a136-a622-4844-8617-0928fd28f2e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:58:56 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a68ea27a-e7ee-46cb-a30d-ac10d2cee9ca tempest-VolumesMetadataTest-1438866721 None] Created volume successfully.
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Flow 'volume_create_manager' (7359b0f0-932c-4a40-9624-06ee7bd3d4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebae511e-9f0b-440b-967f-5e7ac6cf5544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebae511e-9f0b-440b-967f-5e7ac6cf5544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-481726264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c72d975-9351-4742-bce3-8d5e9a8a8321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d423f7ad2bc44a6e868fa5497e6fe6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=184e4373-c0ec-414d-bb53-16af9442b9aa,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:56Z,use_quota=True,user_id='03e594c1c7704695871bb157f6616f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f46606-e7cf-41d6-860b-0a41e16845ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f46606-e7cf-41d6-860b-0a41e16845ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5e6f59-5c15-4a96-9775-671cb43a2f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5e6f59-5c15-4a96-9775-671cb43a2f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5c72d975-9351-4742-bce3-8d5e9a8a8321', 'volume_name': 'volume-5c72d975-9351-4742-bce3-8d5e9a8a8321', 'volume_size': 2, 'snapshot_id': '184e4373-c0ec-414d-bb53-16af9442b9aa'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae37b0d-741c-4daf-bf1a-c716b9760e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae37b0d-741c-4daf-bf1a-c716b9760e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b475140-2414-4d0a-aea6-9542529e2d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:58:56 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Volume 5c72d975-9351-4742-bce3-8d5e9a8a8321: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5c72d975-9351-4742-bce3-8d5e9a8a8321', 'volume_size': 2, 'snapshot_id': '184e4373-c0ec-414d-bb53-16af9442b9aa'}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-184e4373-c0ec-414d-bb53-16af9442b9aa-5c72d975-9351-4742-bce3-8d5e9a8a8321" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-184e4373-c0ec-414d-bb53-16af9442b9aa-5c72d975-9351-4742-bce3-8d5e9a8a8321" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Creating volume 5c72d975-9351-4742-bce3-8d5e9a8a8321 from snapshot 184e4373-c0ec-414d-bb53-16af9442b9aa {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-5c72d975-9351-4742-bce3-8d5e9a8a8321" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-5c72d975-9351-4742-bce3-8d5e9a8a8321" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] snapshot: 184e4373-c0ec-414d-bb53-16af9442b9aa, volume: 5c72d975-9351-4742-bce3-8d5e9a8a8321,  {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[18199b15-6d08-42d6-b984-ab6e9c9f7d69]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:56 devstack sudo[94600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa
Nov 03 16:58:56 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:57 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa" returned: 0 in 0.714s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cb255e5-ab63-4f23-953d-6d162da9f20e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:58:57 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bb8d14-6aad-46b7-bb9b-086bb2eafb07]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:57 devstack sudo[94607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e
Nov 03 16:58:57 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:58 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root
Nov 03 16:58:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e" returned: 0 in 0.686s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:58:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:58:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:58:58 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Path /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:58:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:58:58 devstack sudo[94613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321
Nov 03 16:58:58 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:58:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Acquiring lock "cinder-8c65d303-d747-4ed8-a00c-72b531606a8f-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Lock "cinder-8c65d303-d747-4ed8-a00c-72b531606a8f-delete_volume" acquired by "delete_volume" :: waited 0.179s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Acquiring lock "cinder-quobyte-8c65d303-d747-4ed8-a00c-72b531606a8f" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:58:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Lock "cinder-quobyte-8c65d303-d747-4ed8-a00c-72b531606a8f" acquired by "delete_volume" :: waited 0.081s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:58:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[993a90a9-aa4c-4fdd-87e7-ec448d4e38c1]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:58:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8c65d303-d747-4ed8-a00c-72b531606a8f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:00 devstack sudo[94665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8c65d303-d747-4ed8-a00c-72b531606a8f
Nov 03 16:59:00 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:01 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8c65d303-d747-4ed8-a00c-72b531606a8f" returned: 0 in 1.568s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8c65d303-d747-4ed8-a00c-72b531606a8f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:01 devstack sudo[94708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8c65d303-d747-4ed8-a00c-72b531606a8f
Nov 03 16:59:01 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:02 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8c65d303-d747-4ed8-a00c-72b531606a8f" returned: 0 in 1.142s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Lock "cinder-quobyte-8c65d303-d747-4ed8-a00c-72b531606a8f" released by "delete_volume" :: held 2.901s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:02 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Created reservations ['e990ce9f-9453-4ad0-9574-597533ec3546', '8a726f57-4a51-4bf6-b4be-eae42c86fe36', '0781b0d0-2b19-4b40-9f8d-69304c55da2f', '48955ab6-0297-448e-ba90-74d53af8dde6'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:59:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:03 devstack sudo[94717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:59:03 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:05 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 1.679s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:05 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:59:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Deleted volume successfully.
Nov 03 16:59:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-77534312-b19a-4571-b589-52569b0494ea tempest-VolumesMetadataTest-1438866721 None] Lock "cinder-8c65d303-d747-4ed8-a00c-72b531606a8f-delete_volume" released by "delete_volume" :: held 5.940s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:12 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321" returned: 0 in 14.544s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:12 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e, size 1024.00 MB, duration 14.55 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:59:12 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Converted 1024.00 MB image at 70.40 MB/s
Nov 03 16:59:12 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321 is being set with open permissions: ugo+rw
Nov 03 16:59:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:12 devstack sudo[94816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321
Nov 03 16:59:12 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:13 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321" returned: 0 in 0.260s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-5c72d975-9351-4742-bce3-8d5e9a8a8321" released by "_copy_volume_from_snapshot" :: held 16.417s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-184e4373-c0ec-414d-bb53-16af9442b9aa-5c72d975-9351-4742-bce3-8d5e9a8a8321" released by "_create_volume_from_snapshot" :: held 16.507s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.526s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b475140-2414-4d0a-aea6-9542529e2d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c72d975-9351-4742-bce3-8d5e9a8a8321', 'volume_size': 2, 'snapshot_id': '184e4373-c0ec-414d-bb53-16af9442b9aa'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32ab72d-ba9f-476d-af2f-b5c92b1fb50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:13 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Volume volume-5c72d975-9351-4742-bce3-8d5e9a8a8321 (5c72d975-9351-4742-bce3-8d5e9a8a8321): created successfully
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32ab72d-ba9f-476d-af2f-b5c92b1fb50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Flow 'volume_create_manager' (7359b0f0-932c-4a40-9624-06ee7bd3d4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-931bd979-6323-4987-909f-ff1d33a3e647 tempest-VolumesSnapshotTestJSON-120910895 None] Created volume successfully.
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-5c72d975-9351-4742-bce3-8d5e9a8a8321-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-5c72d975-9351-4742-bce3-8d5e9a8a8321-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-5c72d975-9351-4742-bce3-8d5e9a8a8321" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-5c72d975-9351-4742-bce3-8d5e9a8a8321" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f54136-f413-4e0a-9514-49e634f3dcd9]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:13 devstack sudo[94819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321
Nov 03 16:59:13 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:14 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321" returned: 0 in 0.412s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:14 devstack sudo[94824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321
Nov 03 16:59:14 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:14 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5c72d975-9351-4742-bce3-8d5e9a8a8321" returned: 0 in 0.281s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-5c72d975-9351-4742-bce3-8d5e9a8a8321" released by "delete_volume" :: held 0.752s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Created reservations ['4c109c42-e224-4bf0-9d85-5e34745a9e57', '72b5f64c-dd73-4782-bf8e-794fa19fe478', '12ffe0f6-3653-4b48-b42d-481dd7e730ea', '7395c8f4-ff71-4227-9e4d-822fd943c37a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:14 devstack sudo[94827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:59:14 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-184e4373-c0ec-414d-bb53-16af9442b9aa-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Flow 'volume_create_manager' (6fc3fbe6-5b21-4f87-ba24-c7fd51f35b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca8bcae-8ea2-43c6-8ac0-ce899956ca38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca8bcae-8ea2-43c6-8ac0-ce899956ca38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1188479951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee1a516-9c96-4669-ab6c-921396df38d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c2b0f7ddb6840aa9b4b05cb85fda973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:15Z,use_quota=True,user_id='d87c466a45d44d3e83cda4f798392808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164b86da-dc5c-4e43-9dc6-e041921373df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164b86da-dc5c-4e43-9dc6-e041921373df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bc5c1c-1a35-40c5-b55e-ec3e60400ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bc5c1c-1a35-40c5-b55e-ec3e60400ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ee1a516-9c96-4669-ab6c-921396df38d9', 'volume_name': 'volume-0ee1a516-9c96-4669-ab6c-921396df38d9', 'volume_size': 2}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c609cd9-53ce-41b0-bc04-072d40b4a5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c609cd9-53ce-41b0-bc04-072d40b4a5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915ba422-7e26-4230-894c-44ac579fed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:15 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Volume 0ee1a516-9c96-4669-ab6c-921396df38d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ee1a516-9c96-4669-ab6c-921396df38d9', 'volume_size': 2}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1188479951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee1a516-9c96-4669-ab6c-921396df38d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c2b0f7ddb6840aa9b4b05cb85fda973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:15Z,use_quota=True,user_id='d87c466a45d44d3e83cda4f798392808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Creating volume 0ee1a516-9c96-4669-ab6c-921396df38d9 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:59:15 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ee1a516-9c96-4669-ab6c-921396df38d9 2147483648 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-184e4373-c0ec-414d-bb53-16af9442b9aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.153s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:15 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-0cb255e5-ab63-4f23-953d-6d162da9f20e" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.370s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:59:15 devstack sudo[94830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ee1a516-9c96-4669-ab6c-921396df38d9 2147483648
Nov 03 16:59:15 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Deleted volume successfully.
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-0cb255e5-ab63-4f23-953d-6d162da9f20e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-184e4373-c0ec-414d-bb53-16af9442b9aa" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-184e4373-c0ec-414d-bb53-16af9442b9aa" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Deleting offline snapshot 184e4373-c0ec-414d-bb53-16af9442b9aa of volume 0cb255e5-ab63-4f23-953d-6d162da9f20e {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] snapshot_file for this snap is: volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f5c43ec2-a9f9-403b-8ba7-e264ce292456 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-5c72d975-9351-4742-bce3-8d5e9a8a8321-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[59317359-195d-47ea-be32-969a7e6f7bba]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:15 devstack sudo[94832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa
Nov 03 16:59:15 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:15 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa" returned: 0 in 0.426s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cb255e5-ab63-4f23-953d-6d162da9f20e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:59:15 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ee1a516-9c96-4669-ab6c-921396df38d9 2147483648" returned: 0 in 0.572s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e96d00-01d6-4981-b01c-829f022c63c2]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ee1a516-9c96-4669-ab6c-921396df38d9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:15 devstack sudo[94842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ee1a516-9c96-4669-ab6c-921396df38d9
Nov 03 16:59:15 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:15 devstack sudo[94841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e
Nov 03 16:59:15 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:16 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ee1a516-9c96-4669-ab6c-921396df38d9" returned: 0 in 0.327s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:59:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915ba422-7e26-4230-894c-44ac579fed0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee1a516-9c96-4669-ab6c-921396df38d9', 'volume_size': 2}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6960bf4-68c1-4286-8949-1db81f1af0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Volume volume-0ee1a516-9c96-4669-ab6c-921396df38d9 (0ee1a516-9c96-4669-ab6c-921396df38d9): created successfully
Nov 03 16:59:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6960bf4-68c1-4286-8949-1db81f1af0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Flow 'volume_create_manager' (6fc3fbe6-5b21-4f87-ba24-c7fd51f35b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1a37c0cc-2818-40c4-bfb8-5c32b96b7c73 tempest-VolumesCloneNegativeTest-179878993 None] Created volume successfully.
Nov 03 16:59:16 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e" returned: 0 in 0.575s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:16 devstack sudo[94850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa
Nov 03 16:59:16 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:16 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa" returned: 0 in 0.428s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:16 devstack sudo[94863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa
Nov 03 16:59:16 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:17 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e.184e4373-c0ec-414d-bb53-16af9442b9aa" returned: 0 in 0.387s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-184e4373-c0ec-414d-bb53-16af9442b9aa" released by "_delete_snapshot" :: held 2.004s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-0cb255e5-ab63-4f23-953d-6d162da9f20e" released by "delete_snapshot" :: held 2.051s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:17 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Created reservations ['afd2143b-a91b-4dc7-88f9-adee5df475fb', '2d1e37a4-b5c7-44e9-b34b-7006d84c26e9', 'a56398fc-1bd5-4ddd-8557-c4fbe61c2a38', '8790ab81-1461-4d3a-94dd-7f670522965e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:59:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Acquiring lock "cinder-0ee1a516-9c96-4669-ab6c-921396df38d9-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Lock "cinder-0ee1a516-9c96-4669-ab6c-921396df38d9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Delete snapshot completed successfully.
Nov 03 16:59:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7a1374c-c7db-4e77-a14d-3920dfb01052 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-184e4373-c0ec-414d-bb53-16af9442b9aa-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Acquiring lock "cinder-quobyte-0ee1a516-9c96-4669-ab6c-921396df38d9" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Lock "cinder-quobyte-0ee1a516-9c96-4669-ab6c-921396df38d9" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:17 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be3e480-b441-4eb1-97e9-05a538744def]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ee1a516-9c96-4669-ab6c-921396df38d9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:17 devstack sudo[94875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ee1a516-9c96-4669-ab6c-921396df38d9
Nov 03 16:59:17 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:17 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ee1a516-9c96-4669-ab6c-921396df38d9" returned: 0 in 0.462s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ee1a516-9c96-4669-ab6c-921396df38d9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:17 devstack sudo[94899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ee1a516-9c96-4669-ab6c-921396df38d9
Nov 03 16:59:17 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:18 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ee1a516-9c96-4669-ab6c-921396df38d9" returned: 0 in 0.310s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Lock "cinder-quobyte-0ee1a516-9c96-4669-ab6c-921396df38d9" released by "delete_volume" :: held 0.842s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-0cb255e5-ab63-4f23-953d-6d162da9f20e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-0cb255e5-ab63-4f23-953d-6d162da9f20e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Created reservations ['0dfde122-89f9-4b2a-b4c1-1adba3add27c', 'e4f5b5ad-c85d-4e4e-9524-03e1d548ea2e', '16b0b44b-f198-4669-84ea-7ae561f01146', '1d79a941-5693-419b-b2f6-d9a14a6aed8e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-0cb255e5-ab63-4f23-953d-6d162da9f20e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-0cb255e5-ab63-4f23-953d-6d162da9f20e" acquired by "delete_volume" :: waited 0.036s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[18219a60-31da-46a7-b486-49e40ca199ad]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:18 devstack sudo[94909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:59:18 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:18 devstack sudo[94910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e
Nov 03 16:59:18 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:18 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.318s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:59:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Deleted volume successfully.
Nov 03 16:59:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec0f98b1-4bf8-46df-b328-fb00ad2daf00 tempest-VolumesCloneNegativeTest-179878993 None] Lock "cinder-0ee1a516-9c96-4669-ab6c-921396df38d9-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:19 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e" returned: 0 in 0.491s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:19 devstack sudo[94917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e
Nov 03 16:59:19 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:19 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0cb255e5-ab63-4f23-953d-6d162da9f20e" returned: 0 in 0.301s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-0cb255e5-ab63-4f23-953d-6d162da9f20e" released by "delete_volume" :: held 0.910s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Created reservations ['92491171-8d95-4c40-8b31-44762bf030b9', '9fbabbd3-e1f9-4303-a1e1-09dc6aca064f', 'f251b8c2-63ba-45ff-8e3a-a449e1200e3d', '7823b14c-57e1-4ade-9acf-51946c6901d6'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:19 devstack sudo[94920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:59:19 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:19 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.325s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:59:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Deleted volume successfully.
Nov 03 16:59:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d5b94bf-4f44-4289-a5a4-cbacaafead79 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-0cb255e5-ab63-4f23-953d-6d162da9f20e-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Flow 'volume_create_manager' (a63268ee-ccab-4bfd-a616-4b9e27bd380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53519be-44b9-430d-8c2c-9050c9a37427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53519be-44b9-430d-8c2c-9050c9a37427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1354186283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a511c004-befb-4b3b-bf6a-6f7c1ccd49ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d423f7ad2bc44a6e868fa5497e6fe6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:20Z,use_quota=True,user_id='03e594c1c7704695871bb157f6616f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf599107-e779-409e-8f83-4621fe6fa10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf599107-e779-409e-8f83-4621fe6fa10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84247cf8-d510-427d-959a-bde5492b3900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84247cf8-d510-427d-959a-bde5492b3900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a511c004-befb-4b3b-bf6a-6f7c1ccd49ca', 'volume_name': 'volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd09372-d883-4595-8a5c-57ff584d27ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd09372-d883-4595-8a5c-57ff584d27ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ce9713-b2c9-46c9-9c6b-31a9a8f73544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Volume a511c004-befb-4b3b-bf6a-6f7c1ccd49ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca', 'volume_size': 1}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1354186283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a511c004-befb-4b3b-bf6a-6f7c1ccd49ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d423f7ad2bc44a6e868fa5497e6fe6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:20Z,use_quota=True,user_id='03e594c1c7704695871bb157f6616f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Creating volume a511c004-befb-4b3b-bf6a-6f7c1ccd49ca {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:59:20 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:20 devstack sudo[94924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca 1073741824
Nov 03 16:59:20 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:20 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca 1073741824" returned: 0 in 0.486s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:20 devstack sudo[94930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca
Nov 03 16:59:20 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:21 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:59:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ce9713-b2c9-46c9-9c6b-31a9a8f73544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789b79d6-b61a-4d16-b7fd-0771266e2357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:21 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Volume volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca (a511c004-befb-4b3b-bf6a-6f7c1ccd49ca): created successfully
Nov 03 16:59:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789b79d6-b61a-4d16-b7fd-0771266e2357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Flow 'volume_create_manager' (a63268ee-ccab-4bfd-a616-4b9e27bd380c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f69c06b1-b7e2-467c-9c36-4b16d1bc3cb6 tempest-VolumesSnapshotTestJSON-120910895 None] Created volume successfully.
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] Creating offline snapshot eafc4f31-03c5-4b06-acac-d75711f07571 of volume a511c004-befb-4b3b-bf6a-6f7c1ccd49ca {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d416969b-2af0-413f-bf84-cdf8ca1e7b33]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:22 devstack sudo[94933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca
Nov 03 16:59:22 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (673ca3cd-6b52-414f-9530-72364842286c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d72d07a-d85b-47e6-b171-3e95de087caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d72d07a-d85b-47e6-b171-3e95de087caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1795491058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44afa97d-572b-43ee-a12a-3fc073b34c15,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='23d480e7a32749e38c74f8f861c62295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:23Z,use_quota=True,user_id='8ff167b0fcc04699893d35163e42229d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa65499-7dc9-490f-a53e-7e215de1f74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa65499-7dc9-490f-a53e-7e215de1f74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2a6fe2-8836-4dfb-92eb-94b7b7096ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2a6fe2-8836-4dfb-92eb-94b7b7096ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44afa97d-572b-43ee-a12a-3fc073b34c15', 'volume_name': 'volume-44afa97d-572b-43ee-a12a-3fc073b34c15', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7748dea2-3bf1-42c2-8006-3a31bca490ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7748dea2-3bf1-42c2-8006-3a31bca490ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327ed26c-fac7-4501-bad8-d6b765c9f681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Volume 44afa97d-572b-43ee-a12a-3fc073b34c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44afa97d-572b-43ee-a12a-3fc073b34c15', 'volume_size': 1}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:22 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca" returned: 0 in 0.340s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:22 devstack sudo[94939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571 1G
Nov 03 16:59:22 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:23 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571 1G" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:23 devstack sudo[94944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571
Nov 03 16:59:23 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:23 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:23 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571 is being set with open permissions: ugo+rw
Nov 03 16:59:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:23 devstack sudo[94949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571
Nov 03 16:59:23 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:23 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571" returned: 0 in 0.222s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:23 devstack sudo[94952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.info
Nov 03 16:59:23 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:24 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.info" returned: 0 in 0.241s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:24 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.info is being set with open permissions: ugo+rw
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:24 devstack sudo[94955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.info
Nov 03 16:59:24 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:24 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.info" returned: 0 in 0.241s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.581s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1795491058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44afa97d-572b-43ee-a12a-3fc073b34c15,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='23d480e7a32749e38c74f8f861c62295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:23Z,use_quota=True,user_id='8ff167b0fcc04699893d35163e42229d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Creating volume 44afa97d-572b-43ee-a12a-3fc073b34c15 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:59:24 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44afa97d-572b-43ee-a12a-3fc073b34c15 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:24 devstack sudo[94958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44afa97d-572b-43ee-a12a-3fc073b34c15 1073741824
Nov 03 16:59:24 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-348b0ae3-c5cd-417c-8f39-87a96a600df0 tempest-VolumesSnapshotTestJSON-120910895 None] Create snapshot completed successfully
Nov 03 16:59:24 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44afa97d-572b-43ee-a12a-3fc073b34c15 1073741824" returned: 0 in 0.533s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44afa97d-572b-43ee-a12a-3fc073b34c15 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:25 devstack sudo[94964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44afa97d-572b-43ee-a12a-3fc073b34c15
Nov 03 16:59:25 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:25 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44afa97d-572b-43ee-a12a-3fc073b34c15" returned: 0 in 0.430s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327ed26c-fac7-4501-bad8-d6b765c9f681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44afa97d-572b-43ee-a12a-3fc073b34c15', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383f5fe7-26fc-4fca-979c-e7fde53e9085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:25 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Volume volume-44afa97d-572b-43ee-a12a-3fc073b34c15 (44afa97d-572b-43ee-a12a-3fc073b34c15): created successfully
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383f5fe7-26fc-4fca-979c-e7fde53e9085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (673ca3cd-6b52-414f-9530-72364842286c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ebdcd794-ea85-4cd9-a90b-cd16b1179c3e tempest-VolumesGetTest-391285225 None] Created volume successfully.
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Flow 'volume_create_manager' (cda62911-4c62-414a-9146-868bd297a881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd30a76-d74b-4987-a894-5ae65c3eb8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd30a76-d74b-4987-a894-5ae65c3eb8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1352897384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d423f7ad2bc44a6e868fa5497e6fe6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eafc4f31-03c5-4b06-acac-d75711f07571,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:26Z,use_quota=True,user_id='03e594c1c7704695871bb157f6616f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4519070a-a6ff-4800-aa7c-da56f6b15a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4519070a-a6ff-4800-aa7c-da56f6b15a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c623d65-3ae8-42ca-b3c4-c54650ce8dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c623d65-3ae8-42ca-b3c4-c54650ce8dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a', 'volume_name': 'volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a', 'volume_size': 1, 'snapshot_id': 'eafc4f31-03c5-4b06-acac-d75711f07571'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456f6dfc-a559-4419-ac69-8e48672a84bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456f6dfc-a559-4419-ac69-8e48672a84bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935792d9-6e4d-4f5e-ad9f-bd81bdb8f782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:25 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Volume 7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a', 'volume_size': 1, 'snapshot_id': 'eafc4f31-03c5-4b06-acac-d75711f07571'}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-eafc4f31-03c5-4b06-acac-d75711f07571-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-eafc4f31-03c5-4b06-acac-d75711f07571-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Creating volume 7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a from snapshot eafc4f31-03c5-4b06-acac-d75711f07571 {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] snapshot: eafc4f31-03c5-4b06-acac-d75711f07571, volume: 7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a,  {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d865965-7c8b-44ec-ab45-6911519d7c2f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:26 devstack sudo[94973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571
Nov 03 16:59:26 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Flow 'volume_create_manager' (49dd29a0-dd15-4860-b839-8bcd7106b5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e33263-90aa-48ed-9322-638971b410ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e33263-90aa-48ed-9322-638971b410ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-747935662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d95f234f-f158-48c2-a325-1072eaba98a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243c4155ed1e46dc9b6620a22ce957a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:26Z,use_quota=True,user_id='5a5ca2adbed94aac94986dbe39e3cba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2df30f-09e9-4e5a-9eba-87aa735af624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2df30f-09e9-4e5a-9eba-87aa735af624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea723fe5-1f15-4c7c-8f26-8c6d184b8013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea723fe5-1f15-4c7c-8f26-8c6d184b8013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd95f234f-f158-48c2-a325-1072eaba98a1', 'volume_name': 'volume-d95f234f-f158-48c2-a325-1072eaba98a1', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2362aa5e-10ce-45ef-a5aa-3b59e4ea2b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2362aa5e-10ce-45ef-a5aa-3b59e4ea2b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90119250-612b-4aa7-8b16-7aa7fb46dc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Volume d95f234f-f158-48c2-a325-1072eaba98a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d95f234f-f158-48c2-a325-1072eaba98a1', 'volume_size': 1}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:26 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571" returned: 0 in 0.509s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ead610-06b0-4fba-b987-814ffc6f56e7]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:26 devstack sudo[94978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca
Nov 03 16:59:26 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (8d6d192f-8c80-432b-9362-c87214171e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:26 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c499bf7b-c48d-4ccb-981d-b45881accda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Path /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:26 devstack sudo[94983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c499bf7b-c48d-4ccb-981d-b45881accda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-431943073',display_name='tempest-VolumesGetTest-Volume-572897342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d129800b-0ebe-4856-be36-4b1990666000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d480e7a32749e38c74f8f861c62295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:27Z,use_quota=True,user_id='8ff167b0fcc04699893d35163e42229d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:26 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d967c76c-91ac-4493-b677-10892f5a12b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d967c76c-91ac-4493-b677-10892f5a12b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd73f79-51f0-4cf5-a241-f743e9baaa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd73f79-51f0-4cf5-a241-f743e9baaa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd129800b-0ebe-4856-be36-4b1990666000', 'volume_name': 'volume-d129800b-0ebe-4856-be36-4b1990666000', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7c3589-9795-4d9b-9d58-d26e1fa3382e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7c3589-9795-4d9b-9d58-d26e1fa3382e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973a4e9b-0ef0-4167-a332-8ff244bc1afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Volume d129800b-0ebe-4856-be36-4b1990666000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d129800b-0ebe-4856-be36-4b1990666000', 'volume_size': 1}
Nov 03 16:59:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=73,cinder:UPDATE=72,cinder:DELETE=6,cinder:INSERT=9 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=64,cinder:UPDATE=70,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Flow 'volume_create_manager' (9efb4b7b-ff1b-40ad-a127-9cef072c6816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed0ab2e-4f9c-44c5-b8da-3044565984c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed0ab2e-4f9c-44c5-b8da-3044565984c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1147894380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5897f997-3a95-4d83-91b5-d1b13e8f818c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94128e38bf4060a676f41bb62316e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:32Z,use_quota=True,user_id='91a07d7932f5437eb03ef8df89296f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395152ef-082d-4942-9aa3-dc07f396708a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395152ef-082d-4942-9aa3-dc07f396708a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a612d659-c9d6-47a4-b8c4-d563aeeaa591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a612d659-c9d6-47a4-b8c4-d563aeeaa591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5897f997-3a95-4d83-91b5-d1b13e8f818c', 'volume_name': 'volume-5897f997-3a95-4d83-91b5-d1b13e8f818c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfe0056-9eaf-408c-b6e2-5936b35e2054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfe0056-9eaf-408c-b6e2-5936b35e2054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021ddf0b-4fd0-4f5f-8da2-902aa773397d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Volume 5897f997-3a95-4d83-91b5-d1b13e8f818c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5897f997-3a95-4d83-91b5-d1b13e8f818c', 'volume_size': 1}
Nov 03 16:59:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:32 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a" returned: 0 in 6.056s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:32 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:59:32 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Converted 1024.00 MB image at 169.06 MB/s
Nov 03 16:59:32 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a is being set with open permissions: ugo+rw
Nov 03 16:59:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:32 devstack sudo[95000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a
Nov 03 16:59:32 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:33 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a" returned: 0 in 0.226s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a" released by "_copy_volume_from_snapshot" :: held 7.379s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-eafc4f31-03c5-4b06-acac-d75711f07571-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a" released by "_create_volume_from_snapshot" :: held 7.470s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.500s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.806s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-747935662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d95f234f-f158-48c2-a325-1072eaba98a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243c4155ed1e46dc9b6620a22ce957a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:26Z,use_quota=True,user_id='5a5ca2adbed94aac94986dbe39e3cba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Creating volume d95f234f-f158-48c2-a325-1072eaba98a1 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:59:33 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d95f234f-f158-48c2-a325-1072eaba98a1 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:33 devstack sudo[95003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d95f234f-f158-48c2-a325-1072eaba98a1 1073741824
Nov 03 16:59:33 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935792d9-6e4d-4f5e-ad9f-bd81bdb8f782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a', 'volume_size': 1, 'snapshot_id': 'eafc4f31-03c5-4b06-acac-d75711f07571'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd427cf-5b13-47a6-81cd-ca83965d8898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Volume volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a (7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a): created successfully
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd427cf-5b13-47a6-81cd-ca83965d8898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Flow 'volume_create_manager' (cda62911-4c62-414a-9146-868bd297a881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-47d96c03-2b20-41bb-905b-a195bcc627e7 tempest-VolumesSnapshotTestJSON-120910895 None] Created volume successfully.
Nov 03 16:59:33 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d95f234f-f158-48c2-a325-1072eaba98a1 1073741824" returned: 0 in 0.412s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d95f234f-f158-48c2-a325-1072eaba98a1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:33 devstack sudo[95009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d95f234f-f158-48c2-a325-1072eaba98a1
Nov 03 16:59:33 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:33 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d95f234f-f158-48c2-a325-1072eaba98a1" returned: 0 in 0.229s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.953s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-431943073',display_name='tempest-VolumesGetTest-Volume-572897342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d129800b-0ebe-4856-be36-4b1990666000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d480e7a32749e38c74f8f861c62295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:27Z,use_quota=True,user_id='8ff167b0fcc04699893d35163e42229d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Creating volume d129800b-0ebe-4856-be36-4b1990666000 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:59:33 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d129800b-0ebe-4856-be36-4b1990666000 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90119250-612b-4aa7-8b16-7aa7fb46dc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d95f234f-f158-48c2-a325-1072eaba98a1', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:33 devstack sudo[95012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d129800b-0ebe-4856-be36-4b1990666000 1073741824
Nov 03 16:59:33 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd63e4b-a217-4c67-abff-503cc2a328ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Volume volume-d95f234f-f158-48c2-a325-1072eaba98a1 (d95f234f-f158-48c2-a325-1072eaba98a1): created successfully
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd63e4b-a217-4c67-abff-503cc2a328ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Flow 'volume_create_manager' (49dd29a0-dd15-4860-b839-8bcd7106b5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0a2638aa-67bb-49ea-a439-d050f6c40e2c tempest-AttachVolumeTestJSON-1584899401 None] Created volume successfully.
Nov 03 16:59:34 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d129800b-0ebe-4856-be36-4b1990666000 1073741824" returned: 0 in 0.431s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d129800b-0ebe-4856-be36-4b1990666000 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:34 devstack sudo[95018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d129800b-0ebe-4856-be36-4b1990666000
Nov 03 16:59:34 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[701a0f2c-0e91-4581-a01a-da3d30244b64]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:34 devstack sudo[95020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a
Nov 03 16:59:34 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:34 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d129800b-0ebe-4856-be36-4b1990666000" returned: 0 in 0.271s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.735s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1147894380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5897f997-3a95-4d83-91b5-d1b13e8f818c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94128e38bf4060a676f41bb62316e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:32Z,use_quota=True,user_id='91a07d7932f5437eb03ef8df89296f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Creating volume 5897f997-3a95-4d83-91b5-d1b13e8f818c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:59:34 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5897f997-3a95-4d83-91b5-d1b13e8f818c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:34 devstack sudo[95023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5897f997-3a95-4d83-91b5-d1b13e8f818c 1073741824
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973a4e9b-0ef0-4167-a332-8ff244bc1afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d129800b-0ebe-4856-be36-4b1990666000', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:34 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a871b30f-494f-42d9-a5ab-607767f6d0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:34 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Volume volume-d129800b-0ebe-4856-be36-4b1990666000 (d129800b-0ebe-4856-be36-4b1990666000): created successfully
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a871b30f-494f-42d9-a5ab-607767f6d0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (8d6d192f-8c80-432b-9362-c87214171e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5b872757-45c4-4731-8149-f661906e6a39 tempest-VolumesGetTest-391285225 None] Created volume successfully.
Nov 03 16:59:34 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a" returned: 0 in 0.373s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:34 devstack sudo[95028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a
Nov 03 16:59:34 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:35 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a" returned: 0 in 0.266s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a" released by "delete_volume" :: held 0.694s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:35 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5897f997-3a95-4d83-91b5-d1b13e8f818c 1073741824" returned: 0 in 0.497s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5897f997-3a95-4d83-91b5-d1b13e8f818c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Created reservations ['b2679c6b-3230-4abb-88c6-df282d371975', '0d6257f0-9df4-4ef8-befe-9ace688f2a31', '694274bf-040c-4aae-8a02-9fd6f3f63583', 'a8fa46ee-ed49-4156-a854-c94cdd51e2a3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:59:35 devstack sudo[95039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5897f997-3a95-4d83-91b5-d1b13e8f818c
Nov 03 16:59:35 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:35 devstack sudo[95041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:59:35 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:35 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5897f997-3a95-4d83-91b5-d1b13e8f818c" returned: 0 in 0.387s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021ddf0b-4fd0-4f5f-8da2-902aa773397d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5897f997-3a95-4d83-91b5-d1b13e8f818c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ce330e-a7e8-4921-9dfc-311d49b43581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:35 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Volume volume-5897f997-3a95-4d83-91b5-d1b13e8f818c (5897f997-3a95-4d83-91b5-d1b13e8f818c): created successfully
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ce330e-a7e8-4921-9dfc-311d49b43581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Flow 'volume_create_manager' (9efb4b7b-ff1b-40ad-a127-9cef072c6816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-d129800b-0ebe-4856-be36-4b1990666000-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7f71db56-32bd-461a-bf28-c536c8acc5f1 tempest-AttachVolumeNegativeTest-920650290 None] Created volume successfully.
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Lock "cinder-d129800b-0ebe-4856-be36-4b1990666000-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-quobyte-d129800b-0ebe-4856-be36-4b1990666000" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-d129800b-0ebe-4856-be36-4b1990666000" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:35 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-eafc4f31-03c5-4b06-acac-d75711f07571-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.481s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad23f78-9724-421a-8a12-fc598f0be8c6]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d129800b-0ebe-4856-be36-4b1990666000 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-eafc4f31-03c5-4b06-acac-d75711f07571-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Deleted volume successfully.
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-eafc4f31-03c5-4b06-acac-d75711f07571" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b5763eed-aba3-492a-9247-bb62a20367e6 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-7de44cd6-54a5-48c7-a5cc-7c2ae52daa3a-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-eafc4f31-03c5-4b06-acac-d75711f07571" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Deleting offline snapshot eafc4f31-03c5-4b06-acac-d75711f07571 of volume a511c004-befb-4b3b-bf6a-6f7c1ccd49ca {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:59:36 devstack sudo[95046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d129800b-0ebe-4856-be36-4b1990666000
Nov 03 16:59:36 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] snapshot_file for this snap is: volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb63fb4c-f2e4-4e99-a031-9d1947bfa182]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:36 devstack sudo[95054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571
Nov 03 16:59:36 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-68207834-b074-489a-a456-5a4745e907a7 req-206950fb-ff88-43cd-bb8a-c0067c3e829f tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-68207834-b074-489a-a456-5a4745e907a7 req-206950fb-ff88-43cd-bb8a-c0067c3e829f tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-68207834-b074-489a-a456-5a4745e907a7 req-206950fb-ff88-43cd-bb8a-c0067c3e829f tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-68207834-b074-489a-a456-5a4745e907a7 req-206950fb-ff88-43cd-bb8a-c0067c3e829f tempest-AttachVolumeTestJSON-1584899401 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-d95f234f-f158-48c2-a325-1072eaba98a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8daaf9e-2830-45e1-ad41-6a649ed7d59a', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:59:36 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d129800b-0ebe-4856-be36-4b1990666000" returned: 0 in 0.490s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d129800b-0ebe-4856-be36-4b1990666000 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:36 devstack sudo[95065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d129800b-0ebe-4856-be36-4b1990666000
Nov 03 16:59:36 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-68207834-b074-489a-a456-5a4745e907a7 req-206950fb-ff88-43cd-bb8a-c0067c3e829f tempest-AttachVolumeTestJSON-1584899401 None] attachment_update completed successfully.
Nov 03 16:59:36 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571" returned: 0 in 0.455s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[515cea28-988a-4bf2-8fb0-cb23eba0df8b]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:36 devstack sudo[95095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca
Nov 03 16:59:36 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:36 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d129800b-0ebe-4856-be36-4b1990666000" returned: 0 in 0.352s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-d129800b-0ebe-4856-be36-4b1990666000" released by "delete_volume" :: held 0.950s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:36 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Created reservations ['6dc94eda-5ca8-43b5-8423-475910d7316c', '53de4e37-099f-44c7-9cd1-0f3f1a390a49', '59ae558c-f944-43ba-8f61-c38437d8625e', '37364bdf-c54b-4014-bec3-617b60a58d48'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:37 devstack sudo[95493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:59:37 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:37 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca" returned: 0 in 0.736s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f4956ff9-14ca-4c7f-be1a-2576e89f375c req-30966650-a6d6-4361-a053-7ae2d65cb679 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f4956ff9-14ca-4c7f-be1a-2576e89f375c req-30966650-a6d6-4361-a053-7ae2d65cb679 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:37 devstack sudo[95504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571
Nov 03 16:59:37 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:37 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.349s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:59:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Deleted volume successfully.
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f4956ff9-14ca-4c7f-be1a-2576e89f375c req-30966650-a6d6-4361-a053-7ae2d65cb679 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2ba3d889-9130-4bd9-b1a9-65ba3a306133 tempest-VolumesGetTest-391285225 None] Lock "cinder-d129800b-0ebe-4856-be36-4b1990666000-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f4956ff9-14ca-4c7f-be1a-2576e89f375c req-30966650-a6d6-4361-a053-7ae2d65cb679 tempest-AttachVolumeNegativeTest-920650290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-5897f997-3a95-4d83-91b5-d1b13e8f818c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2a3bf70-8642-41cb-98a0-d53b791329f4', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:59:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-f4956ff9-14ca-4c7f-be1a-2576e89f375c req-30966650-a6d6-4361-a053-7ae2d65cb679 tempest-AttachVolumeNegativeTest-920650290 None] attachment_update completed successfully.
Nov 03 16:59:37 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571" returned: 0 in 0.372s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:37 devstack sudo[95512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571
Nov 03 16:59:37 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:37 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca.eafc4f31-03c5-4b06-acac-d75711f07571" returned: 0 in 0.270s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-eafc4f31-03c5-4b06-acac-d75711f07571" released by "_delete_snapshot" :: held 2.018s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca" released by "delete_snapshot" :: held 2.069s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:38 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Created reservations ['84a05310-748a-4f71-9a8d-2054850c8c92', 'e4056fd4-b440-4401-ab3e-7a0a97178b62', '79f5169f-f501-4baa-9953-881b6e4c7654', '6d795e49-06c1-4b0e-b2b7-fdb48f8bcb1d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:59:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-44afa97d-572b-43ee-a12a-3fc073b34c15-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Lock "cinder-44afa97d-572b-43ee-a12a-3fc073b34c15-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Delete snapshot completed successfully.
Nov 03 16:59:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-quobyte-44afa97d-572b-43ee-a12a-3fc073b34c15" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-895c1f65-ac56-4629-97f2-70b14d911d21 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-eafc4f31-03c5-4b06-acac-d75711f07571-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-44afa97d-572b-43ee-a12a-3fc073b34c15" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fb2d47-a8aa-4c9d-93c0-a91882c4ead0]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44afa97d-572b-43ee-a12a-3fc073b34c15 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:38 devstack sudo[95515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44afa97d-572b-43ee-a12a-3fc073b34c15
Nov 03 16:59:38 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:38 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44afa97d-572b-43ee-a12a-3fc073b34c15" returned: 0 in 0.486s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44afa97d-572b-43ee-a12a-3fc073b34c15 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:38 devstack sudo[95524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44afa97d-572b-43ee-a12a-3fc073b34c15
Nov 03 16:59:38 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:39 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44afa97d-572b-43ee-a12a-3fc073b34c15" returned: 0 in 0.292s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-44afa97d-572b-43ee-a12a-3fc073b34c15" released by "delete_volume" :: held 0.831s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Created reservations ['8fe84c53-edaf-473b-936d-80e0555f092c', '74dff796-fb5e-4504-94ed-47fa538efee5', 'afa59d5d-1af7-4fd2-9324-5d19e8f99b3f', 'd671a709-2a60-4db4-af8d-293a1451203e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:59:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-6e7896c0-b0aa-4f43-9b13-df266e1481ea req-761ce4ff-afe4-4138-a600-1ac15058d7c2 tempest-AttachVolumeNegativeTest-920650290 None] Terminate volume connection completed successfully.
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-6e7896c0-b0aa-4f43-9b13-df266e1481ea req-761ce4ff-afe4-4138-a600-1ac15058d7c2 tempest-AttachVolumeNegativeTest-920650290 None] Deleting attachment b2a3bf70-8642-41cb-98a0-d53b791329f4. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26b979d-8aa5-49da-a59a-521da7eb246c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:39 devstack sudo[95558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:59:39 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:39 devstack sudo[95559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca
Nov 03 16:59:39 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:39 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.275s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:59:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Deleted volume successfully.
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-19b38da5-98a5-48c7-a89d-4b17e333df21 tempest-VolumesGetTest-391285225 None] Lock "cinder-44afa97d-572b-43ee-a12a-3fc073b34c15-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:39 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca" returned: 0 in 0.456s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:39 devstack sudo[95567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca
Nov 03 16:59:39 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (b156ac9f-ba28-4226-b804-fd392da63fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ec2fb8-11ff-4671-9c3a-e233d0916c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ec2fb8-11ff-4671-9c3a-e233d0916c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-727326466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004e8f6b-f47d-42b6-a109-04ec60997c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d480e7a32749e38c74f8f861c62295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:40Z,use_quota=True,user_id='8ff167b0fcc04699893d35163e42229d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95beef9f-d7b5-4dce-9093-d1a9cb29c7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95beef9f-d7b5-4dce-9093-d1a9cb29c7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edcb242-f2bf-47d1-8c7b-42a90b65928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edcb242-f2bf-47d1-8c7b-42a90b65928c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '004e8f6b-f47d-42b6-a109-04ec60997c00', 'volume_name': 'volume-004e8f6b-f47d-42b6-a109-04ec60997c00', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4695520e-80b3-4642-b3bb-148a822dbc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4695520e-80b3-4642-b3bb-148a822dbc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58171b0d-cac9-4ff0-8c95-5af348437ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Volume 004e8f6b-f47d-42b6-a109-04ec60997c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-004e8f6b-f47d-42b6-a109-04ec60997c00', 'volume_size': 1}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-727326466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004e8f6b-f47d-42b6-a109-04ec60997c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d480e7a32749e38c74f8f861c62295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:40Z,use_quota=True,user_id='8ff167b0fcc04699893d35163e42229d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Creating volume 004e8f6b-f47d-42b6-a109-04ec60997c00 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:59:39 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 16:59:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:40 devstack sudo[95569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00 1073741824
Nov 03 16:59:40 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:40 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca" returned: 0 in 0.277s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca" released by "delete_volume" :: held 0.846s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Created reservations ['18d7f9b0-7cea-46cd-9864-5f4780552cf1', '980f5502-fa11-45ad-8625-d275f15d84dc', '6d2ccc12-bbdd-48bb-9937-79e8eb00d7a8', 'f912c6fe-4d60-44ad-a050-0d23dc693654'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:40 devstack sudo[95575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:59:40 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-cfc1b9af-e65a-410f-8667-aaf3e642c728-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-cfc1b9af-e65a-410f-8667-aaf3e642c728-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "cinder-quobyte-cfc1b9af-e65a-410f-8667-aaf3e642c728" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-cfc1b9af-e65a-410f-8667-aaf3e642c728" acquired by "delete_volume" :: waited 0.071s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc5b89a-2912-4a54-b0eb-fa21e34a46ea]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:40 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.609s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:59:40 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00 1073741824" returned: 0 in 0.922s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Deleted volume successfully.
Nov 03 16:59:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aca7c35e-4c5e-4a4b-880f-b877e51a9e11 tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-a511c004-befb-4b3b-bf6a-6f7c1ccd49ca-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:41 devstack sudo[95603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00
Nov 03 16:59:41 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:41 devstack sudo[95598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728
Nov 03 16:59:41 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:41 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00" returned: 0 in 0.313s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58171b0d-cac9-4ff0-8c95-5af348437ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-004e8f6b-f47d-42b6-a109-04ec60997c00', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc74d2c-dc5c-4a1b-87f1-6abebf0d0980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Volume volume-004e8f6b-f47d-42b6-a109-04ec60997c00 (004e8f6b-f47d-42b6-a109-04ec60997c00): created successfully
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc74d2c-dc5c-4a1b-87f1-6abebf0d0980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (b156ac9f-ba28-4226-b804-fd392da63fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-343e81b8-5b2c-407a-a451-680f2ac64a03 tempest-VolumesGetTest-391285225 None] Created volume successfully.
Nov 03 16:59:41 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728" returned: 0 in 0.570s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:41 devstack sudo[95611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728
Nov 03 16:59:41 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:41 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cfc1b9af-e65a-410f-8667-aaf3e642c728" returned: 0 in 0.325s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-quobyte-cfc1b9af-e65a-410f-8667-aaf3e642c728" released by "delete_volume" :: held 1.045s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Created reservations ['ef41db30-d97a-490b-9b49-7302d72169db', 'ec228f78-5e9e-4eef-98c4-a80c34e46335', '8ac4f1ca-c837-4fff-b124-6c71ee7fea95', 'f0ae06f2-7e7e-4ffc-82c7-0af2279a9bf0'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:41 devstack sudo[95615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:59:41 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:42 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.372s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:42 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:59:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Deleted volume successfully.
Nov 03 16:59:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-40367675-9839-44ab-a913-cc15838623db tempest-VolumesSnapshotTestJSON-120910895 None] Lock "cinder-cfc1b9af-e65a-410f-8667-aaf3e642c728-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:42 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (f6ee5667-e386-45d7-837e-a42bfba242e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9145dde0-cc30-4259-a717-47cf67a82afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9145dde0-cc30-4259-a717-47cf67a82afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-396377503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cce341-d826-4dc7-8cb5-4173fcbccb1c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='23d480e7a32749e38c74f8f861c62295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=004e8f6b-f47d-42b6-a109-04ec60997c00,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:43Z,use_quota=True,user_id='8ff167b0fcc04699893d35163e42229d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb9a945-24c8-4509-8ac1-5e4bbef69d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb9a945-24c8-4509-8ac1-5e4bbef69d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c9ee15-0720-4ce6-b83c-4d69d40158a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c9ee15-0720-4ce6-b83c-4d69d40158a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '17cce341-d826-4dc7-8cb5-4173fcbccb1c', 'volume_name': 'volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c', 'volume_size': 1, 'source_volid': '004e8f6b-f47d-42b6-a109-04ec60997c00', 'source_volstatus': 'available'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49179073-54b0-4181-a920-3c4787ae420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49179073-54b0-4181-a920-3c4787ae420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec27176-6d70-40c9-bc27-2f5ed7b6a3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:59:43 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Volume 17cce341-d826-4dc7-8cb5-4173fcbccb1c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c', 'volume_size': 1, 'source_volid': '004e8f6b-f47d-42b6-a109-04ec60997c00', 'source_volstatus': 'available'}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:43 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Cloning volume 004e8f6b-f47d-42b6-a109-04ec60997c00 to volume 17cce341-d826-4dc7-8cb5-4173fcbccb1c
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Creating offline snapshot 30a78209-8386-45b4-9416-dfd391297b0e of volume 004e8f6b-f47d-42b6-a109-04ec60997c00 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d664437b-66a4-4a3c-9929-f032e43097e0]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:43 devstack sudo[95743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00
Nov 03 16:59:43 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00" returned: 0 in 0.578s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:43 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:43 devstack sudo[95759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e 1G
Nov 03 16:59:43 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:44 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e 1G" returned: 0 in 0.868s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004e8f6b-f47d-42b6-a109-04ec60997c00 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:44 devstack sudo[96136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004e8f6b-f47d-42b6-a109-04ec60997c00 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e
Nov 03 16:59:44 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:45 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004e8f6b-f47d-42b6-a109-04ec60997c00 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e" returned: 0 in 0.580s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:45 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e is being set with open permissions: ugo+rw
Nov 03 16:59:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:45 devstack sudo[96146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e
Nov 03 16:59:45 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:45 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e" returned: 0 in 0.333s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:45 devstack sudo[96149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.info
Nov 03 16:59:45 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:46 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.info" returned: 0 in 0.460s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:46 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.info is being set with open permissions: ugo+rw
Nov 03 16:59:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:46 devstack sudo[96155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.info
Nov 03 16:59:46 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:46 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.info" returned: 0 in 0.404s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-quobyte-17cce341-d826-4dc7-8cb5-4173fcbccb1c" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-17cce341-d826-4dc7-8cb5-4173fcbccb1c" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] snapshot: 30a78209-8386-45b4-9416-dfd391297b0e, volume: 17cce341-d826-4dc7-8cb5-4173fcbccb1c,  {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:59:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[48524404-bafa-44e8-aa9d-0d3f43e0477d]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:46 devstack sudo[96158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e
Nov 03 16:59:46 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:47 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e" returned: 0 in 0.473s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004e8f6b-f47d-42b6-a109-04ec60997c00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:59:47 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b9b8c9-4a85-4018-9027-911184aeed1e]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:47 devstack sudo[96164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00
Nov 03 16:59:47 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:47 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00" returned: 0 in 0.603s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:59:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:59:47 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Path /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:59:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:47 devstack sudo[96169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c
Nov 03 16:59:47 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:59:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:59:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:59:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:59:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:59:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:59:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:51 devstack sudo[96185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 16:59:51 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:52 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.859s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:59:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:59:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:59:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:59:55 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=57,cinder:UPDATE=69,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:59:55 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=54,cinder:UPDATE=56,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:59:58 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c" returned: 0 in 10.301s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:58 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00, size 1024.00 MB, duration 10.30 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:59:58 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Converted 1024.00 MB image at 99.40 MB/s
Nov 03 16:59:58 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c is being set with open permissions: ugo+rw
Nov 03 16:59:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:58 devstack sudo[96196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c
Nov 03 16:59:58 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:58 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c" returned: 0 in 0.450s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-17cce341-d826-4dc7-8cb5-4173fcbccb1c" released by "_copy_volume_from_snapshot" :: held 11.930s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:59:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-quobyte-30a78209-8386-45b4-9416-dfd391297b0e" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:59:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-30a78209-8386-45b4-9416-dfd391297b0e" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:59:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Deleting offline snapshot 30a78209-8386-45b4-9416-dfd391297b0e of volume 004e8f6b-f47d-42b6-a109-04ec60997c00 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:59:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] snapshot_file for this snap is: volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:59:58 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7539d13-b734-4a26-a745-fc7e7f997f49]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:58 devstack sudo[96217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e
Nov 03 16:59:58 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:59 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e" returned: 0 in 0.424s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004e8f6b-f47d-42b6-a109-04ec60997c00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:59:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c7c38b-2fc1-4405-bc8d-e6aeac1fe9de]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:59:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:59 devstack sudo[96234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00
Nov 03 16:59:59 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:59:59 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root
Nov 03 16:59:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00" returned: 0 in 0.704s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:59:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:59:59 devstack sudo[96239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e
Nov 03 16:59:59 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:00 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e" returned: 0 in 0.419s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:00 devstack sudo[96246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e
Nov 03 17:00:00 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:00 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00.30a78209-8386-45b4-9416-dfd391297b0e" returned: 0 in 0.318s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-30a78209-8386-45b4-9416-dfd391297b0e" released by "_delete_snapshot" :: held 2.019s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.472s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec27176-6d70-40c9-bc27-2f5ed7b6a3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c', 'volume_size': 1, 'source_volid': '004e8f6b-f47d-42b6-a109-04ec60997c00', 'source_volstatus': 'available'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef58454a-c27a-4718-afbd-80f261f413a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:00 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Volume volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c (17cce341-d826-4dc7-8cb5-4173fcbccb1c): created successfully
Nov 03 17:00:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef58454a-c27a-4718-afbd-80f261f413a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (f6ee5667-e386-45d7-837e-a42bfba242e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:00:00 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-15f14403-8197-460b-9532-360238f334eb tempest-VolumesGetTest-391285225 None] Created volume successfully.
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (fae3ffbf-40a7-4289-9a80-d6a9c5bb7cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9fa040b-65b4-4971-92e2-bf481e119a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9fa040b-65b4-4971-92e2-bf481e119a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:00:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1390930189',display_name='tempest-VolumesGetTest-Volume-2046638497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5cf590-37e4-484b-9b48-027289b23b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d480e7a32749e38c74f8f861c62295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:03Z,use_quota=True,user_id='8ff167b0fcc04699893d35163e42229d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b07ed0-2483-4a26-aad3-03ba183cf7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b07ed0-2483-4a26-aad3-03ba183cf7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b71636f-7946-434a-b4b7-013c0b6819d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b71636f-7946-434a-b4b7-013c0b6819d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5cf590-37e4-484b-9b48-027289b23b78', 'volume_name': 'volume-1c5cf590-37e4-484b-9b48-027289b23b78', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0fef4c-686c-4327-a79c-6ba3126e765a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0fef4c-686c-4327-a79c-6ba3126e765a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac34a75-2c35-4d6d-8691-604c1c68766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:03 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Volume 1c5cf590-37e4-484b-9b48-027289b23b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5cf590-37e4-484b-9b48-027289b23b78', 'volume_size': 1}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:00:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1390930189',display_name='tempest-VolumesGetTest-Volume-2046638497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5cf590-37e4-484b-9b48-027289b23b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d480e7a32749e38c74f8f861c62295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:03Z,use_quota=True,user_id='8ff167b0fcc04699893d35163e42229d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Creating volume 1c5cf590-37e4-484b-9b48-027289b23b78 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:00:03 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1c5cf590-37e4-484b-9b48-027289b23b78 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:03 devstack sudo[96346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1c5cf590-37e4-484b-9b48-027289b23b78 1073741824
Nov 03 17:00:03 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:03 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1c5cf590-37e4-484b-9b48-027289b23b78 1073741824" returned: 0 in 0.600s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1c5cf590-37e4-484b-9b48-027289b23b78 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:03 devstack sudo[96352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1c5cf590-37e4-484b-9b48-027289b23b78
Nov 03 17:00:03 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:04 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1c5cf590-37e4-484b-9b48-027289b23b78" returned: 0 in 0.342s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:00:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac34a75-2c35-4d6d-8691-604c1c68766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5cf590-37e4-484b-9b48-027289b23b78', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d155a31-25c0-414d-acea-a7dd09868211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:04 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Volume volume-1c5cf590-37e4-484b-9b48-027289b23b78 (1c5cf590-37e4-484b-9b48-027289b23b78): created successfully
Nov 03 17:00:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d155a31-25c0-414d-acea-a7dd09868211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (fae3ffbf-40a7-4289-9a80-d6a9c5bb7cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:00:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2225a17e-b9b3-4c16-830e-db4e9acd8356 tempest-VolumesGetTest-391285225 None] Created volume successfully.
Nov 03 17:00:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-1c5cf590-37e4-484b-9b48-027289b23b78-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Lock "cinder-1c5cf590-37e4-484b-9b48-027289b23b78-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-quobyte-1c5cf590-37e4-484b-9b48-027289b23b78" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-1c5cf590-37e4-484b-9b48-027289b23b78" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b846781-35cb-48f0-ae60-5293c60f6861]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1c5cf590-37e4-484b-9b48-027289b23b78 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:05 devstack sudo[96355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1c5cf590-37e4-484b-9b48-027289b23b78
Nov 03 17:00:05 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:06 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1c5cf590-37e4-484b-9b48-027289b23b78" returned: 0 in 0.652s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1c5cf590-37e4-484b-9b48-027289b23b78 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:06 devstack sudo[96360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1c5cf590-37e4-484b-9b48-027289b23b78
Nov 03 17:00:06 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:06 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1c5cf590-37e4-484b-9b48-027289b23b78" returned: 0 in 0.311s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-1c5cf590-37e4-484b-9b48-027289b23b78" released by "delete_volume" :: held 1.048s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:06 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Created reservations ['51652361-4eab-4f08-bf61-e62d9eb45685', '8568cf06-509b-421f-9723-a405f546cb0a', '558c2193-e470-4b25-9af9-415d85c836fe', '291e1597-bb57-458f-b17b-5ee88ee0d64e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:00:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:06 devstack sudo[96363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:00:06 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:07 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.372s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:07 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:00:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Deleted volume successfully.
Nov 03 17:00:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66e6e9b8-7ec8-43db-a7ed-24215d6dbef7 tempest-VolumesGetTest-391285225 None] Lock "cinder-1c5cf590-37e4-484b-9b48-027289b23b78-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-17cce341-d826-4dc7-8cb5-4173fcbccb1c-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Lock "cinder-17cce341-d826-4dc7-8cb5-4173fcbccb1c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-quobyte-17cce341-d826-4dc7-8cb5-4173fcbccb1c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-17cce341-d826-4dc7-8cb5-4173fcbccb1c" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52f4121-0822-4910-a200-be2004e5f1a3]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:08 devstack sudo[96367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c
Nov 03 17:00:08 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:09 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c" returned: 0 in 0.916s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:09 devstack sudo[96413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c
Nov 03 17:00:09 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:09 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-17cce341-d826-4dc7-8cb5-4173fcbccb1c" returned: 0 in 0.465s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-17cce341-d826-4dc7-8cb5-4173fcbccb1c" released by "delete_volume" :: held 1.480s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:09 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Created reservations ['f2b2c5f2-d1af-4faf-8089-0c07d78c1b9f', '7a91f0a0-1fb8-4492-9292-7159c42549c3', 'f8b46c60-f8fb-4d59-a354-531d115d0dc4', '2c98dd33-f7cc-4da6-8f75-e1a61d37bad7'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:00:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:10 devstack sudo[96420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:00:10 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:10 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.458s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:10 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:00:10 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Deleted volume successfully.
Nov 03 17:00:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d1cf5c7f-679c-4151-8371-2681b27e9bb5 tempest-VolumesGetTest-391285225 None] Lock "cinder-17cce341-d826-4dc7-8cb5-4173fcbccb1c-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-004e8f6b-f47d-42b6-a109-04ec60997c00-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Lock "cinder-004e8f6b-f47d-42b6-a109-04ec60997c00-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-quobyte-004e8f6b-f47d-42b6-a109-04ec60997c00" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-004e8f6b-f47d-42b6-a109-04ec60997c00" acquired by "delete_volume" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:11 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc3b281-9c71-4bcb-b9b6-605e27b8cbc2]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-c98c5010-ec91-46cd-b502-13b848fa9b12 req-180aeb1a-e881-4800-9004-b6965d08b058 tempest-AttachVolumeTestJSON-1584899401 None] Terminate volume connection completed successfully.
Nov 03 17:00:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-c98c5010-ec91-46cd-b502-13b848fa9b12 req-180aeb1a-e881-4800-9004-b6965d08b058 tempest-AttachVolumeTestJSON-1584899401 None] Deleting attachment a8daaf9e-2830-45e1-ad41-6a649ed7d59a. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:00:11 devstack sudo[96428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00
Nov 03 17:00:11 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:11 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00" returned: 0 in 0.748s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:11 devstack sudo[96434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00
Nov 03 17:00:11 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:12 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-004e8f6b-f47d-42b6-a109-04ec60997c00" returned: 0 in 0.390s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-004e8f6b-f47d-42b6-a109-04ec60997c00" released by "delete_volume" :: held 1.265s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:12 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Created reservations ['16936421-dc9b-4480-aac8-4e688c2f145e', 'df758d97-90a9-4981-b77e-f212a60c42fd', '7e362c44-0f3c-4e6d-b9ef-77e94ed65da9', 'f5e37b7f-3995-4687-a564-05a6802521df'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:00:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:12 devstack sudo[96441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:00:12 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:12 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.320s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:12 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:00:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Deleted volume successfully.
Nov 03 17:00:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-62b465c8-802c-4913-b146-dcf3b0e09c28 tempest-VolumesGetTest-391285225 None] Lock "cinder-004e8f6b-f47d-42b6-a109-04ec60997c00-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:14 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:00:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (5e988b7b-265d-415d-9b80-471593c0d327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:00:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88d9f7f-aa82-4c33-9512-a2ae3493afd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88d9f7f-aa82-4c33-9512-a2ae3493afd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-40190311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2a8597-27f4-47e3-aa20-9ce83696f38c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='23d480e7a32749e38c74f8f861c62295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:14Z,use_quota=True,user_id='8ff167b0fcc04699893d35163e42229d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fc3b7d-c848-4b3b-a605-03738452f19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fc3b7d-c848-4b3b-a605-03738452f19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6db8b6-0702-4e47-bb89-9b8cf61df915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:14 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 17:00:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6db8b6-0702-4e47-bb89-9b8cf61df915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c2a8597-27f4-47e3-aa20-9ce83696f38c', 'volume_name': 'volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e72454e9040>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253c9d74-3a4b-477e-bf99-5b8acd9c226b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253c9d74-3a4b-477e-bf99-5b8acd9c226b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd503ea-0fec-4dba-b12a-2c71c6a5e0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:14 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Volume 6c2a8597-27f4-47e3-aa20-9ce83696f38c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e72454e9040>}
Nov 03 17:00:14 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Trying to clone 6c2a8597-27f4-47e3-aa20-9ce83696f38c from image 12ab4fb0-81c3-4967-9eea-39afb443d41b at location (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 17:00:15 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 17:00:15 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 17:00:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7512f2-2157-46b0-b0ce-3bcfa3e82f21]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:15 devstack sudo[96448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD
Nov 03 17:00:15 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:16 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD" returned: 0 in 0.665s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Temporary image 12ab4fb0-81c3-4967-9eea-39afb443d41b is fetched for user 8ff167b0fcc04699893d35163e42229d. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e310e054-9139-4ff4-a740-4eb61cffbd37]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:16 devstack sudo[96511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD
Nov 03 17:00:16 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:16 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-40190311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2a8597-27f4-47e3-aa20-9ce83696f38c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='23d480e7a32749e38c74f8f861c62295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:14Z,use_quota=True,user_id='8ff167b0fcc04699893d35163e42229d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Creating volume 6c2a8597-27f4-47e3-aa20-9ce83696f38c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:00:16 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:00:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:16 devstack sudo[96524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c 1073741824
Nov 03 17:00:16 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:17 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c 1073741824" returned: 0 in 0.948s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:17 devstack sudo[96597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c
Nov 03 17:00:17 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:18 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c" returned: 0 in 0.367s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:00:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:18 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Attempting download of 12ab4fb0-81c3-4967-9eea-39afb443d41b ((None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}])) to volume 6c2a8597-27f4-47e3-aa20-9ce83696f38c. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 17:00:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[978e2a93-0d9a-4bef-9c32-11574a6d27ef]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_dfllxd7z {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:18 devstack sudo[96616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_dfllxd7z
Nov 03 17:00:18 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:19 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_dfllxd7z" returned: 0 in 0.625s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_dfllxd7z {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:19 devstack sudo[96625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_dfllxd7z
Nov 03 17:00:19 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:19 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_dfllxd7z" returned: 1 in 0.518s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_dfllxd7z' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:00:19 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb41037-3538-4d77-b0b3-09e5f3a6a854]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:19 devstack sudo[96630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD
Nov 03 17:00:19 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:19 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:20 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] 12ab4fb0-81c3-4967-9eea-39afb443d41b was qcow2, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 17:00:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:20 devstack sudo[96635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c
Nov 03 17:00:20 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:22 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c" returned: 0 in 2.831s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:22 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_c0wgdxnidevstack@QuobyteHD, size 112.00 MB, duration 2.83 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:00:22 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Converted 112.00 MB image at 39.54 MB/s
Nov 03 17:00:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:22 devstack sudo[96644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c 1G
Nov 03 17:00:22 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:23 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c 1G" returned: 0 in 0.642s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:23 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Downloaded image 12ab4fb0-81c3-4967-9eea-39afb443d41b ((None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}])) to volume 6c2a8597-27f4-47e3-aa20-9ce83696f38c successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 17:00:23 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Temporary image 12ab4fb0-81c3-4967-9eea-39afb443d41b for user 8ff167b0fcc04699893d35163e42229d is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 17:00:23 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Marking volume 6c2a8597-27f4-47e3-aa20-9ce83696f38c as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 17:00:23 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Copying metadata from image 12ab4fb0-81c3-4967-9eea-39afb443d41b to 6c2a8597-27f4-47e3-aa20-9ce83696f38c. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 17:00:23 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Creating volume glance metadata for volume 6c2a8597-27f4-47e3-aa20-9ce83696f38c backed by image 12ab4fb0-81c3-4967-9eea-39afb443d41b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 17:00:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd503ea-0fec-4dba-b12a-2c71c6a5e0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e72454e9040>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f48926-6a6e-4dd7-b861-7188162ba26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Volume volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c (6c2a8597-27f4-47e3-aa20-9ce83696f38c): created successfully
Nov 03 17:00:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f48926-6a6e-4dd7-b861-7188162ba26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (5e988b7b-265d-415d-9b80-471593c0d327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:00:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c1bbc853-6dc5-4fee-9e9d-89ed3e6ce068 tempest-VolumesGetTest-391285225 None] Created volume successfully.
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (b571ab0c-4d71-4cd3-bfea-e32d72304d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3168f336-1c5e-4422-8e40-ea9dd67f4e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3168f336-1c5e-4422-8e40-ea9dd67f4e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:00:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-860900396',display_name='tempest-VolumesGetTest-Volume-1672779909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e07a33-714b-4e46-a77a-ee7d476ff653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d480e7a32749e38c74f8f861c62295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:26Z,use_quota=True,user_id='8ff167b0fcc04699893d35163e42229d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bef454-9e92-4678-b1ee-ed956b90ceb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bef454-9e92-4678-b1ee-ed956b90ceb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dde4212-1b64-4eb6-83e8-0f69ddc960dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dde4212-1b64-4eb6-83e8-0f69ddc960dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76e07a33-714b-4e46-a77a-ee7d476ff653', 'volume_name': 'volume-76e07a33-714b-4e46-a77a-ee7d476ff653', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402c096d-a14c-4c69-b60f-0d28956794e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402c096d-a14c-4c69-b60f-0d28956794e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09124e21-bdc0-4a77-a7c2-4af6d42cd519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:25 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Volume 76e07a33-714b-4e46-a77a-ee7d476ff653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76e07a33-714b-4e46-a77a-ee7d476ff653', 'volume_size': 1}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:00:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-860900396',display_name='tempest-VolumesGetTest-Volume-1672779909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e07a33-714b-4e46-a77a-ee7d476ff653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d480e7a32749e38c74f8f861c62295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:26Z,use_quota=True,user_id='8ff167b0fcc04699893d35163e42229d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Creating volume 76e07a33-714b-4e46-a77a-ee7d476ff653 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:00:25 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:00:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76e07a33-714b-4e46-a77a-ee7d476ff653 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:25 devstack sudo[96649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76e07a33-714b-4e46-a77a-ee7d476ff653 1073741824
Nov 03 17:00:25 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:26 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76e07a33-714b-4e46-a77a-ee7d476ff653 1073741824" returned: 0 in 0.572s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76e07a33-714b-4e46-a77a-ee7d476ff653 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:26 devstack sudo[96655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76e07a33-714b-4e46-a77a-ee7d476ff653
Nov 03 17:00:26 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:26 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76e07a33-714b-4e46-a77a-ee7d476ff653" returned: 0 in 0.532s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:00:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09124e21-bdc0-4a77-a7c2-4af6d42cd519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e07a33-714b-4e46-a77a-ee7d476ff653', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a822e843-ce46-4013-9755-0ab51af7dcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:27 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Volume volume-76e07a33-714b-4e46-a77a-ee7d476ff653 (76e07a33-714b-4e46-a77a-ee7d476ff653): created successfully
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a822e843-ce46-4013-9755-0ab51af7dcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Flow 'volume_create_manager' (b571ab0c-4d71-4cd3-bfea-e32d72304d32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:00:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fd568ca8-5043-4b9f-b789-843ea20b5809 tempest-VolumesGetTest-391285225 None] Created volume successfully.
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Flow 'volume_create_manager' (7ecdda26-6a29-44c0-8b5a-8366d9459034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd59ccc-5937-41d1-940c-e9f455f2eb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd59ccc-5937-41d1-940c-e9f455f2eb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-906705703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a319a097-907b-44ef-9e9c-cbbf88290a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94128e38bf4060a676f41bb62316e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:27Z,use_quota=True,user_id='91a07d7932f5437eb03ef8df89296f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c35bc61-cf53-4550-a661-dcf0113baffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c35bc61-cf53-4550-a661-dcf0113baffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bc9a50-7f39-45aa-b1c9-f72d0410f956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bc9a50-7f39-45aa-b1c9-f72d0410f956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a319a097-907b-44ef-9e9c-cbbf88290a39', 'volume_name': 'volume-a319a097-907b-44ef-9e9c-cbbf88290a39', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7904c4-ac6f-44ea-bf1f-21dd85508280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7904c4-ac6f-44ea-bf1f-21dd85508280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5965a5d2-e67c-4706-b295-607bea7faf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:27 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Volume a319a097-907b-44ef-9e9c-cbbf88290a39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a319a097-907b-44ef-9e9c-cbbf88290a39', 'volume_size': 1}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-906705703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a319a097-907b-44ef-9e9c-cbbf88290a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94128e38bf4060a676f41bb62316e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:27Z,use_quota=True,user_id='91a07d7932f5437eb03ef8df89296f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Creating volume a319a097-907b-44ef-9e9c-cbbf88290a39 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:00:27 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:00:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a319a097-907b-44ef-9e9c-cbbf88290a39 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:27 devstack sudo[96660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a319a097-907b-44ef-9e9c-cbbf88290a39 1073741824
Nov 03 17:00:27 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-76e07a33-714b-4e46-a77a-ee7d476ff653-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Lock "cinder-76e07a33-714b-4e46-a77a-ee7d476ff653-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-quobyte-76e07a33-714b-4e46-a77a-ee7d476ff653" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-76e07a33-714b-4e46-a77a-ee7d476ff653" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:28 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a319a097-907b-44ef-9e9c-cbbf88290a39 1073741824" returned: 0 in 0.590s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e040d10-b19c-402d-bdad-08c29804c4c8]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76e07a33-714b-4e46-a77a-ee7d476ff653 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a319a097-907b-44ef-9e9c-cbbf88290a39 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:28 devstack sudo[96667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a319a097-907b-44ef-9e9c-cbbf88290a39
Nov 03 17:00:28 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:28 devstack sudo[96666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76e07a33-714b-4e46-a77a-ee7d476ff653
Nov 03 17:00:28 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:28 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a319a097-907b-44ef-9e9c-cbbf88290a39" returned: 0 in 0.366s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5965a5d2-e67c-4706-b295-607bea7faf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a319a097-907b-44ef-9e9c-cbbf88290a39', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249e0f42-c1a1-4bf4-9832-eacdee8c9977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:28 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Volume volume-a319a097-907b-44ef-9e9c-cbbf88290a39 (a319a097-907b-44ef-9e9c-cbbf88290a39): created successfully
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249e0f42-c1a1-4bf4-9832-eacdee8c9977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Flow 'volume_create_manager' (7ecdda26-6a29-44c0-8b5a-8366d9459034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:00:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6d6f3695-1ee2-4d5d-9310-9ce12ba52d46 tempest-AttachVolumeNegativeTest-920650290 None] Created volume successfully.
Nov 03 17:00:28 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76e07a33-714b-4e46-a77a-ee7d476ff653" returned: 0 in 0.574s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76e07a33-714b-4e46-a77a-ee7d476ff653 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:28 devstack sudo[96674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76e07a33-714b-4e46-a77a-ee7d476ff653
Nov 03 17:00:28 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:29 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-76e07a33-714b-4e46-a77a-ee7d476ff653" returned: 0 in 0.281s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-76e07a33-714b-4e46-a77a-ee7d476ff653" released by "delete_volume" :: held 0.932s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:29 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Created reservations ['e7b8764a-cd75-454d-8f81-c6db81b7c363', '4e3054f4-789f-4b12-ac1e-d9cf5e034592', 'd9b77371-4bd7-4be9-81fa-74be1db5a8d3', '4f3ebfdd-6f50-46a6-97b0-2b061f2f3313'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:00:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:29 devstack sudo[96677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:00:29 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:29 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.265s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:29 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:00:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Deleted volume successfully.
Nov 03 17:00:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-72ddaac4-78fc-4eca-95ff-c722fb8412e0 tempest-VolumesGetTest-391285225 None] Lock "cinder-76e07a33-714b-4e46-a77a-ee7d476ff653-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-6c2a8597-27f4-47e3-aa20-9ce83696f38c-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Lock "cinder-6c2a8597-27f4-47e3-aa20-9ce83696f38c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Acquiring lock "cinder-quobyte-6c2a8597-27f4-47e3-aa20-9ce83696f38c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-6c2a8597-27f4-47e3-aa20-9ce83696f38c" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3859fab9-698a-4127-895d-59181d15da39]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:30 devstack sudo[96686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c
Nov 03 17:00:30 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-1ceb4569-bc7d-4575-ab55-2aba68cab6fd req-e2c964a1-8a82-4cd1-b560-9462d567f16f tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-1ceb4569-bc7d-4575-ab55-2aba68cab6fd req-e2c964a1-8a82-4cd1-b560-9462d567f16f tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-1ceb4569-bc7d-4575-ab55-2aba68cab6fd req-e2c964a1-8a82-4cd1-b560-9462d567f16f tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-1ceb4569-bc7d-4575-ab55-2aba68cab6fd req-e2c964a1-8a82-4cd1-b560-9462d567f16f tempest-AttachVolumeNegativeTest-920650290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-a319a097-907b-44ef-9e9c-cbbf88290a39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2788777-721b-4305-bf53-2db45ce03818', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:00:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-1ceb4569-bc7d-4575-ab55-2aba68cab6fd req-e2c964a1-8a82-4cd1-b560-9462d567f16f tempest-AttachVolumeNegativeTest-920650290 None] attachment_update completed successfully.
Nov 03 17:00:31 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c" returned: 0 in 0.544s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:31 devstack sudo[96701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c
Nov 03 17:00:31 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:31 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6c2a8597-27f4-47e3-aa20-9ce83696f38c" returned: 0 in 0.311s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Lock "cinder-quobyte-6c2a8597-27f4-47e3-aa20-9ce83696f38c" released by "delete_volume" :: held 0.936s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Created reservations ['abb63622-c028-44b5-8dd3-da119cbcd4a3', 'ebba69c9-a157-4406-bfba-1c256c9a3979', 'ce4e04f7-1109-43d3-ab45-74f9e2c0d26d', '3a443f0d-34d7-4fd5-b0c6-9d670bc623cd'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:31 devstack sudo[97119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:00:31 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:32 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.340s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:00:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Deleted volume successfully.
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0f7a45f2-9eee-4db4-ba3b-5ebcba4f4aee tempest-VolumesGetTest-391285225 None] Lock "cinder-6c2a8597-27f4-47e3-aa20-9ce83696f38c-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Flow 'volume_create_manager' (ef0286b6-8566-4728-bc55-d4c6471cfbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694b69a7-cd39-46fe-8477-2f77a9e1a4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694b69a7-cd39-46fe-8477-2f77a9e1a4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-557389473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966d2706-06df-4ce8-9f14-3c966ea5273e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cad8a5236b4ae69041826e54b02a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:32Z,use_quota=True,user_id='a4515b90560b46c2b1239600d838beef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cdc2fa-4613-431b-99d2-1d7aebe858f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cdc2fa-4613-431b-99d2-1d7aebe858f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae9d099-2452-430b-9466-bd0c02e4042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae9d099-2452-430b-9466-bd0c02e4042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '966d2706-06df-4ce8-9f14-3c966ea5273e', 'volume_name': 'volume-966d2706-06df-4ce8-9f14-3c966ea5273e', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e72452b2930>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1835183-2e5b-4fe0-95bf-5296513fdb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1835183-2e5b-4fe0-95bf-5296513fdb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71c648e-6b64-42ed-853d-6fe90087f9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:32 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Volume 966d2706-06df-4ce8-9f14-3c966ea5273e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-966d2706-06df-4ce8-9f14-3c966ea5273e', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e72452b2930>}
Nov 03 17:00:32 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Trying to clone 966d2706-06df-4ce8-9f14-3c966ea5273e from image 12ab4fb0-81c3-4967-9eea-39afb443d41b at location (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 17:00:33 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 17:00:33 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 17:00:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcb24a3-ab96-4c2b-afa8-03b1217b3369]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:33 devstack sudo[97123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD
Nov 03 17:00:33 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:33 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:33 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Temporary image 12ab4fb0-81c3-4967-9eea-39afb443d41b is fetched for user a4515b90560b46c2b1239600d838beef. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 17:00:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45e74ca-dbf0-4b1d-93c2-8c4ca8c40193]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-99134c3f-556f-4cc4-88c9-284dd8b8a57e req-7093666a-4226-40f7-b5ea-7af6e76d9a04 tempest-AttachVolumeNegativeTest-920650290 None] Terminate volume connection completed successfully.
Nov 03 17:00:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-99134c3f-556f-4cc4-88c9-284dd8b8a57e req-7093666a-4226-40f7-b5ea-7af6e76d9a04 tempest-AttachVolumeNegativeTest-920650290 None] Deleting attachment e2788777-721b-4305-bf53-2db45ce03818. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:00:33 devstack sudo[97154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD
Nov 03 17:00:33 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:34 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-557389473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966d2706-06df-4ce8-9f14-3c966ea5273e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cad8a5236b4ae69041826e54b02a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:32Z,use_quota=True,user_id='a4515b90560b46c2b1239600d838beef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Creating volume 966d2706-06df-4ce8-9f14-3c966ea5273e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:00:34 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:34 devstack sudo[97160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e 1073741824
Nov 03 17:00:34 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:34 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e 1073741824" returned: 0 in 0.536s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:34 devstack sudo[97166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e
Nov 03 17:00:34 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:35 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e" returned: 0 in 0.338s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:00:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:35 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Attempting download of 12ab4fb0-81c3-4967-9eea-39afb443d41b ((None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}])) to volume 966d2706-06df-4ce8-9f14-3c966ea5273e. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 17:00:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f279036-64c2-48d6-a8f9-9fb96759f599]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_ft76itu0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:35 devstack sudo[97185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_ft76itu0
Nov 03 17:00:35 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:35 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_ft76itu0" returned: 0 in 0.502s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_ft76itu0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:35 devstack sudo[97194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_ft76itu0
Nov 03 17:00:35 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:36 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_ft76itu0" returned: 1 in 0.470s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_ft76itu0' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[241cd57b-c77f-4c28-bdc3-1f89e36d3699]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:36 devstack sudo[97200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD
Nov 03 17:00:36 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:36 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] 12ab4fb0-81c3-4967-9eea-39afb443d41b was qcow2, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:36 devstack sudo[97206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e
Nov 03 17:00:36 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Flow 'volume_create_manager' (2c062bb5-8654-4866-903b-868260bdf04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a18d5b4-c451-45a2-960e-d7e83c6937fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a18d5b4-c451-45a2-960e-d7e83c6937fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-734213753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b577480451461db563da015c7ab206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:37Z,use_quota=True,user_id='bc71aba1cf8148d08fbbe3824bea9770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d649885-e512-4487-9217-270999f22168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d649885-e512-4487-9217-270999f22168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd3d674-b562-481b-8fd4-f5fb6db81690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd3d674-b562-481b-8fd4-f5fb6db81690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85', 'volume_name': 'volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cae0f0-a264-4b51-9ca4-0b666ccde00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cae0f0-a264-4b51-9ca4-0b666ccde00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb398240-fd74-41de-a03a-7024178321a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:36 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Volume 31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85', 'volume_size': 1}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-734213753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b577480451461db563da015c7ab206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:37Z,use_quota=True,user_id='bc71aba1cf8148d08fbbe3824bea9770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Creating volume 31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:00:36 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:00:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:36 devstack sudo[97208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85 1073741824
Nov 03 17:00:36 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:37 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85 1073741824" returned: 0 in 0.508s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:37 devstack sudo[97218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85
Nov 03 17:00:37 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:37 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85" returned: 0 in 0.386s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:00:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb398240-fd74-41de-a03a-7024178321a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c692c9d5-48fa-4562-ad67-8c3b704e9c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:37 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Volume volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85 (31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85): created successfully
Nov 03 17:00:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c692c9d5-48fa-4562-ad67-8c3b704e9c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Flow 'volume_create_manager' (2c062bb5-8654-4866-903b-868260bdf04f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:00:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3c1c784e-2ac5-4aa4-b368-df8998cb8d7d tempest-VolumesNegativeTest-1033536041 None] Created volume successfully.
Nov 03 17:00:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "cinder-a319a097-907b-44ef-9e9c-cbbf88290a39-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Lock "cinder-a319a097-907b-44ef-9e9c-cbbf88290a39-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "cinder-quobyte-a319a097-907b-44ef-9e9c-cbbf88290a39" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Lock "cinder-quobyte-a319a097-907b-44ef-9e9c-cbbf88290a39" acquired by "delete_volume" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb5bd91-448f-4449-8735-7f275fa040f0]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a319a097-907b-44ef-9e9c-cbbf88290a39 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:39 devstack sudo[97222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a319a097-907b-44ef-9e9c-cbbf88290a39
Nov 03 17:00:39 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:39 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e" returned: 0 in 2.524s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_p7g2zjnndevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:00:39 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Converted 112.00 MB image at 44.35 MB/s
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:39 devstack sudo[97224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e 1G
Nov 03 17:00:39 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:39 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a319a097-907b-44ef-9e9c-cbbf88290a39" returned: 0 in 0.480s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a319a097-907b-44ef-9e9c-cbbf88290a39 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:39 devstack sudo[97229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a319a097-907b-44ef-9e9c-cbbf88290a39
Nov 03 17:00:39 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:39 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e 1G" returned: 0 in 0.425s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Downloaded image 12ab4fb0-81c3-4967-9eea-39afb443d41b ((None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}])) to volume 966d2706-06df-4ce8-9f14-3c966ea5273e successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Temporary image 12ab4fb0-81c3-4967-9eea-39afb443d41b for user a4515b90560b46c2b1239600d838beef is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Marking volume 966d2706-06df-4ce8-9f14-3c966ea5273e as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Copying metadata from image 12ab4fb0-81c3-4967-9eea-39afb443d41b to 966d2706-06df-4ce8-9f14-3c966ea5273e. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Creating volume glance metadata for volume 966d2706-06df-4ce8-9f14-3c966ea5273e backed by image 12ab4fb0-81c3-4967-9eea-39afb443d41b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 17:00:39 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a319a097-907b-44ef-9e9c-cbbf88290a39" returned: 0 in 0.329s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Lock "cinder-quobyte-a319a097-907b-44ef-9e9c-cbbf88290a39" released by "delete_volume" :: held 0.880s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Created reservations ['7e38bd1c-3451-4d59-b556-0effe07843cb', 'cebcf708-034d-489f-8a7e-0ecec7e9ef07', 'b75be139-3ef2-4991-aa24-41c0f3f5aedf', 'a538c5b4-b031-4adc-a006-79fbae03e834'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71c648e-6b64-42ed-853d-6fe90087f9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966d2706-06df-4ce8-9f14-3c966ea5273e', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e72452b2930>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d54b55-0c8f-4657-b287-6531ea5bd939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:00:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Volume volume-966d2706-06df-4ce8-9f14-3c966ea5273e (966d2706-06df-4ce8-9f14-3c966ea5273e): created successfully
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d54b55-0c8f-4657-b287-6531ea5bd939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:00:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Flow 'volume_create_manager' (ef0286b6-8566-4728-bc55-d4c6471cfbdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:00:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2cdc2f1a-0083-4376-a39c-6dfab2748c59 tempest-TestShelveInstance-1659701464 None] Created volume successfully.
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:40 devstack sudo[97239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:00:40 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "cinder-5897f997-3a95-4d83-91b5-d1b13e8f818c-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Lock "cinder-5897f997-3a95-4d83-91b5-d1b13e8f818c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "cinder-quobyte-5897f997-3a95-4d83-91b5-d1b13e8f818c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Lock "cinder-quobyte-5897f997-3a95-4d83-91b5-d1b13e8f818c" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:40 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.373s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[630c597d-dcfd-46c6-b419-d01f0801392f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5897f997-3a95-4d83-91b5-d1b13e8f818c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Deleted volume successfully.
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3c75129-a60e-4c00-8fa8-c9dbb393ea17 tempest-AttachVolumeNegativeTest-920650290 None] Lock "cinder-a319a097-907b-44ef-9e9c-cbbf88290a39-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:40 devstack sudo[97243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5897f997-3a95-4d83-91b5-d1b13e8f818c
Nov 03 17:00:40 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:40 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5897f997-3a95-4d83-91b5-d1b13e8f818c" returned: 0 in 0.490s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5897f997-3a95-4d83-91b5-d1b13e8f818c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:40 devstack sudo[97251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5897f997-3a95-4d83-91b5-d1b13e8f818c
Nov 03 17:00:40 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:41 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5897f997-3a95-4d83-91b5-d1b13e8f818c" returned: 0 in 0.304s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Lock "cinder-quobyte-5897f997-3a95-4d83-91b5-d1b13e8f818c" released by "delete_volume" :: held 0.886s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:41 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Created reservations ['ea6a27c1-9619-43dc-80e4-f2a131f2f51c', '196bc7fb-d792-4c82-ba29-97340405ee67', '313aa75a-bee7-473c-bfd7-c685a08e628f', 'f285b1c6-851a-4577-8a20-d2183f9c6cfb'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:00:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:41 devstack sudo[97257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:00:41 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:41 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.441s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:41 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:00:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Deleted volume successfully.
Nov 03 17:00:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-50aed532-cbdc-4862-9b1d-c0675a206716 tempest-AttachVolumeNegativeTest-920650290 None] Lock "cinder-5897f997-3a95-4d83-91b5-d1b13e8f818c-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "cinder-30d9f09e-1582-4a0c-a366-0654e2e8f993-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Lock "cinder-30d9f09e-1582-4a0c-a366-0654e2e8f993-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "cinder-quobyte-30d9f09e-1582-4a0c-a366-0654e2e8f993" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:00:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Lock "cinder-quobyte-30d9f09e-1582-4a0c-a366-0654e2e8f993" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:00:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9c7432-31a6-4395-b8aa-e9f904c94499]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:00:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30d9f09e-1582-4a0c-a366-0654e2e8f993 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:43 devstack sudo[97299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30d9f09e-1582-4a0c-a366-0654e2e8f993
Nov 03 17:00:43 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:43 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30d9f09e-1582-4a0c-a366-0654e2e8f993" returned: 0 in 0.478s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30d9f09e-1582-4a0c-a366-0654e2e8f993 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:43 devstack sudo[97305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30d9f09e-1582-4a0c-a366-0654e2e8f993
Nov 03 17:00:43 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:44 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30d9f09e-1582-4a0c-a366-0654e2e8f993" returned: 0 in 0.317s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Lock "cinder-quobyte-30d9f09e-1582-4a0c-a366-0654e2e8f993" released by "delete_volume" :: held 0.880s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Created reservations ['abe03095-b1ce-400e-b605-6d262c101547', '04a16f44-2b08-41cf-aafc-8cb0021768a2', 'f210d722-49f5-4a22-a3b3-a6ac9e38fe32', 'afef7c6d-ced0-48ca-8bc8-1d9d0ab73d4a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-e5c156d1-4601-479f-8176-344b049b44d8 req-5deda06f-c974-4fc1-b0e0-76959f95e52b tempest-TestShelveInstance-1659701464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-e5c156d1-4601-479f-8176-344b049b44d8 req-5deda06f-c974-4fc1-b0e0-76959f95e52b tempest-TestShelveInstance-1659701464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-e5c156d1-4601-479f-8176-344b049b44d8 req-5deda06f-c974-4fc1-b0e0-76959f95e52b tempest-TestShelveInstance-1659701464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-e5c156d1-4601-479f-8176-344b049b44d8 req-5deda06f-c974-4fc1-b0e0-76959f95e52b tempest-TestShelveInstance-1659701464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-966d2706-06df-4ce8-9f14-3c966ea5273e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc1e9d54-26ab-484c-a09a-fd1590791d9f', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:00:44 devstack sudo[97319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:00:44 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-e5c156d1-4601-479f-8176-344b049b44d8 req-5deda06f-c974-4fc1-b0e0-76959f95e52b tempest-TestShelveInstance-1659701464 None] attachment_update completed successfully.
Nov 03 17:00:44 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.365s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:00:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Deleted volume successfully.
Nov 03 17:00:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81a94582-4f90-431f-a32f-6c5db88ccaa3 tempest-AttachVolumeNegativeTest-920650290 None] Lock "cinder-30d9f09e-1582-4a0c-a366-0654e2e8f993-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:00:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:00:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:00:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:00:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:00:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:00:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:00:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:00:51 devstack sudo[97395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:00:51 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:00:52 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root
Nov 03 17:00:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.482s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:00:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:00:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:00:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:00:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:00:54 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=90,cinder:SELECT=78,cinder:DELETE=7,cinder:INSERT=36 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:00:54 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=94,cinder:SELECT=89,cinder:INSERT=29,cinder:DELETE=8 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Flow 'volume_create_manager' (e379edc5-52ee-4c31-8155-0a321892fd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a526552d-090b-4d30-94ce-86365dd8fa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a526552d-090b-4d30-94ce-86365dd8fa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1376149455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bfe581-8283-4543-91be-0f4986066ac8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='343fbbebd09a4ab29a87fcf7ba0b14ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:02Z,use_quota=True,user_id='79d424bdd6a24cd69f1f0dccb2736d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9c04d4-3799-4eb4-a815-e036dcb7a909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9c04d4-3799-4eb4-a815-e036dcb7a909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c63196-5471-4345-802a-6279a1bf615d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c63196-5471-4345-802a-6279a1bf615d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74bfe581-8283-4543-91be-0f4986066ac8', 'volume_name': 'volume-74bfe581-8283-4543-91be-0f4986066ac8', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e87814-2182-4366-99d2-824ab635dae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e87814-2182-4366-99d2-824ab635dae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74d4337-c80a-4371-8054-590f9f80059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:02 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Volume 74bfe581-8283-4543-91be-0f4986066ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74bfe581-8283-4543-91be-0f4986066ac8', 'volume_size': 1}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1376149455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bfe581-8283-4543-91be-0f4986066ac8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='343fbbebd09a4ab29a87fcf7ba0b14ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:02Z,use_quota=True,user_id='79d424bdd6a24cd69f1f0dccb2736d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Creating volume 74bfe581-8283-4543-91be-0f4986066ac8 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:01:02 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:01:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-74bfe581-8283-4543-91be-0f4986066ac8 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:02 devstack sudo[97913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-74bfe581-8283-4543-91be-0f4986066ac8 1073741824
Nov 03 17:01:02 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:03 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-74bfe581-8283-4543-91be-0f4986066ac8 1073741824" returned: 0 in 0.917s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-74bfe581-8283-4543-91be-0f4986066ac8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:03 devstack sudo[97921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-74bfe581-8283-4543-91be-0f4986066ac8
Nov 03 17:01:03 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:03 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-74bfe581-8283-4543-91be-0f4986066ac8" returned: 0 in 0.552s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:01:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74d4337-c80a-4371-8054-590f9f80059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74bfe581-8283-4543-91be-0f4986066ac8', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4ae769-f0c1-4ea4-86db-7d8807f6a316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:03 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Volume volume-74bfe581-8283-4543-91be-0f4986066ac8 (74bfe581-8283-4543-91be-0f4986066ac8): created successfully
Nov 03 17:01:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4ae769-f0c1-4ea4-86db-7d8807f6a316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Flow 'volume_create_manager' (e379edc5-52ee-4c31-8155-0a321892fd64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:01:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-7d1e94fa-5651-426b-b165-bb2a63bb7524 req-16db7d16-fe63-4f68-bad6-bde80babbe5a tempest-VolumesGetTestJSON-140823240 None] Created volume successfully.
Nov 03 17:01:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Acquiring lock "cinder-74bfe581-8283-4543-91be-0f4986066ac8-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Lock "cinder-74bfe581-8283-4543-91be-0f4986066ac8-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Acquiring lock "cinder-quobyte-74bfe581-8283-4543-91be-0f4986066ac8" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Lock "cinder-quobyte-74bfe581-8283-4543-91be-0f4986066ac8" acquired by "delete_volume" :: waited 0.054s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[75343f69-9e8e-473d-9019-8290a820b7d5]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-74bfe581-8283-4543-91be-0f4986066ac8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:05 devstack sudo[97980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-74bfe581-8283-4543-91be-0f4986066ac8
Nov 03 17:01:05 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:06 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-74bfe581-8283-4543-91be-0f4986066ac8" returned: 0 in 1.051s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-74bfe581-8283-4543-91be-0f4986066ac8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:06 devstack sudo[97999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-74bfe581-8283-4543-91be-0f4986066ac8
Nov 03 17:01:06 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:06 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-74bfe581-8283-4543-91be-0f4986066ac8" returned: 0 in 0.444s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Lock "cinder-quobyte-74bfe581-8283-4543-91be-0f4986066ac8" released by "delete_volume" :: held 1.637s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:07 devstack cinder-volume[87122]: DEBUG cinder.quota [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Created reservations ['dcedee95-dcf9-46ef-a1c3-09d7d32b0e76', '8e676bf1-bc8a-4b76-aa04-4ccd27da8055', '62e0b0c7-ce38-49a1-a8b3-68800529cecd', '4e0cbcdb-e944-44f4-9519-9532ec5c16bb'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:01:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:07 devstack sudo[98005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:01:07 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:07 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.507s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:07 devstack cinder-volume[87122]: DEBUG cinder.manager [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:01:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Deleted volume successfully.
Nov 03 17:01:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-c8a1b29b-57e8-471a-82df-acef91623570 req-69cb81fb-9f8c-458d-a0f4-bdecf6e55783 tempest-VolumesGetTestJSON-140823240 None] Lock "cinder-74bfe581-8283-4543-91be-0f4986066ac8-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Acquiring lock "cinder-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Lock "cinder-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Acquiring lock "cinder-quobyte-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Lock "cinder-quobyte-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:14 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b474b7-2a2e-4070-941f-c6c86ed86110]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:14 devstack sudo[98083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85
Nov 03 17:01:14 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:14 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85" returned: 0 in 0.676s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:14 devstack sudo[98089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85
Nov 03 17:01:15 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1a0a0ef0-df07-4997-81e2-0a8779ee1495 tempest-BackendsCapabilitiesAdminTestsJSON-1982024214 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7029113769531, 'free_capacity_gb': 1773.7029113769531, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87122) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7152e796-c99b-44cd-821a-159078144564 tempest-BackendsCapabilitiesAdminTestsJSON-1982024214 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7029113769531, 'free_capacity_gb': 1773.7029113769531, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87122) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 03 17:01:15 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85" returned: 0 in 0.373s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Lock "cinder-quobyte-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85" released by "delete_volume" :: held 1.140s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Created reservations ['6cc6ea63-971e-4eef-8a7e-c299a7f87fc2', '0d8dfb46-fe44-460d-984d-82450c0d7acc', '33194f57-fe97-42ab-aa68-73a25014207a', '44bd478e-9b33-4a0f-88ff-72535ea33a88'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:15 devstack sudo[98096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:01:15 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:15 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.357s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:01:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Deleted volume successfully.
Nov 03 17:01:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e1e498c5-60bd-4e48-82e5-fdeb69252f95 tempest-VolumesNegativeTest-1033536041 None] Lock "cinder-31e7c3d6-fb60-4cd5-a2ad-480aa19e8b85-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Flow 'volume_create_manager' (37c70edd-7224-4440-b22e-305e2e7b6b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052b89c6-7d56-4621-bf19-cb121b0cb897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052b89c6-7d56-4621-bf19-cb121b0cb897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-638191294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44aaa6a2-c103-46de-8265-c5717598fc09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d35c034ba84e88a2b2831f2f115604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:21Z,use_quota=True,user_id='47776b9ac7454542a009919a2db6cd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d15f82-7d34-458a-9776-79db585bd9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d15f82-7d34-458a-9776-79db585bd9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33c377c-e627-49a0-9594-5295c723f249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33c377c-e627-49a0-9594-5295c723f249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44aaa6a2-c103-46de-8265-c5717598fc09', 'volume_name': 'volume-44aaa6a2-c103-46de-8265-c5717598fc09', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8747e5f-d27d-4253-b4aa-4ec6c94225d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8747e5f-d27d-4253-b4aa-4ec6c94225d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b73019a-e3c0-4b2d-83d1-9a194365c486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Volume 44aaa6a2-c103-46de-8265-c5717598fc09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44aaa6a2-c103-46de-8265-c5717598fc09', 'volume_size': 1}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-638191294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44aaa6a2-c103-46de-8265-c5717598fc09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d35c034ba84e88a2b2831f2f115604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:21Z,use_quota=True,user_id='47776b9ac7454542a009919a2db6cd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Creating volume 44aaa6a2-c103-46de-8265-c5717598fc09 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:01:20 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:01:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:20 devstack sudo[98109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09 1073741824
Nov 03 17:01:20 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:21 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09 1073741824" returned: 0 in 0.591s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:21 devstack sudo[98128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09
Nov 03 17:01:21 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:21 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09" returned: 0 in 0.290s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:01:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b73019a-e3c0-4b2d-83d1-9a194365c486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44aaa6a2-c103-46de-8265-c5717598fc09', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd9bbfb-1943-4510-98e6-262f2340d619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:21 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Volume volume-44aaa6a2-c103-46de-8265-c5717598fc09 (44aaa6a2-c103-46de-8265-c5717598fc09): created successfully
Nov 03 17:01:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd9bbfb-1943-4510-98e6-262f2340d619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Flow 'volume_create_manager' (37c70edd-7224-4440-b22e-305e2e7b6b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:01:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5560f77e-a741-4aef-aaa0-dc9dc94ad320 tempest-VolumesSnapshotListTestJSON-912485429 None] Created volume successfully.
Nov 03 17:01:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f3a78b3e-2ac4-44d2-ba73-8b272ff2f85b tempest-GroupSnapshotsV319Test-159072194 None] Group tempest-GroupSnapshotsV319Test-Group-793120644: creating
Nov 03 17:01:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f3a78b3e-2ac4-44d2-ba73-8b272ff2f85b tempest-GroupSnapshotsV319Test-159072194 None] Group tempest-GroupSnapshotsV319Test-Group-793120644: created successfully
Nov 03 17:01:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f3a78b3e-2ac4-44d2-ba73-8b272ff2f85b tempest-GroupSnapshotsV319Test-159072194 None] Create group completed successfully.
Nov 03 17:01:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] Creating offline snapshot b8c9c102-b57e-4144-b361-8731a5c8ce37 of volume 44aaa6a2-c103-46de-8265-c5717598fc09 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:01:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f007743-2e2f-441e-9031-f7847e488c8f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:23 devstack sudo[98131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09
Nov 03 17:01:23 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:23 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09" returned: 0 in 0.398s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:23 devstack sudo[98136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 1G
Nov 03 17:01:23 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:24 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 1G" returned: 0 in 0.523s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44aaa6a2-c103-46de-8265-c5717598fc09 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:24 devstack sudo[98158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44aaa6a2-c103-46de-8265-c5717598fc09 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37
Nov 03 17:01:24 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Flow 'volume_create_manager' (fbef74d1-b670-4815-a476-46e988a66d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58011c32-40a9-40c9-8ffc-8b70d8e7e909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58011c32-40a9-40c9-8ffc-8b70d8e7e909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1043646515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0573fc74-bef5-4f37-837c-da2ff68de390,host='devstack@QuobyteHD#QuobyteHD',id=62bc64f0-8300-4166-965a-ed90e4c78772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d399f8c23c04c6f9116c7d889f56763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:24Z,use_quota=True,user_id='8d0f10e530ad40c3bb7b17dd8292b723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48771424-abd9-4d17-99d0-ff7bf1531fac),volume_type_id=48771424-abd9-4d17-99d0-ff7bf1531fac)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a29d700-5870-4fdc-a594-fa840fb0634a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a29d700-5870-4fdc-a594-fa840fb0634a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322c9863-efb3-4b16-aa7b-8ff1592634fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322c9863-efb3-4b16-aa7b-8ff1592634fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62bc64f0-8300-4166-965a-ed90e4c78772', 'volume_name': 'volume-62bc64f0-8300-4166-965a-ed90e4c78772', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040d3b15-99b2-495b-8772-435463bfd3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040d3b15-99b2-495b-8772-435463bfd3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ee67da-04d9-448b-94a8-4c7bcb01a345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:24 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Volume 62bc64f0-8300-4166-965a-ed90e4c78772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62bc64f0-8300-4166-965a-ed90e4c78772', 'volume_size': 1}
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:24 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44aaa6a2-c103-46de-8265-c5717598fc09 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37" returned: 0 in 0.423s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:24 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 is being set with open permissions: ugo+rw
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:24 devstack sudo[98165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37
Nov 03 17:01:24 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:24 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37" returned: 0 in 0.419s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:24 devstack sudo[98169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.info
Nov 03 17:01:24 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:25 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.info" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:25 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.info is being set with open permissions: ugo+rw
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:25 devstack sudo[98175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.info
Nov 03 17:01:25 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:25 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.info" returned: 0 in 0.261s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.416s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.064s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0573fc74-bef5-4f37-837c-da2ff68de390,created_at=2026-11-03T16:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1043646515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0573fc74-bef5-4f37-837c-da2ff68de390,host='devstack@QuobyteHD#QuobyteHD',id=62bc64f0-8300-4166-965a-ed90e4c78772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d399f8c23c04c6f9116c7d889f56763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:24Z,use_quota=True,user_id='8d0f10e530ad40c3bb7b17dd8292b723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48771424-abd9-4d17-99d0-ff7bf1531fac),volume_type_id=48771424-abd9-4d17-99d0-ff7bf1531fac)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Creating volume 62bc64f0-8300-4166-965a-ed90e4c78772 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:01:25 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:01:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:25 devstack sudo[98178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772 1073741824
Nov 03 17:01:25 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c096d750-c701-4a49-bf4a-734bbaad937c tempest-VolumesSnapshotListTestJSON-912485429 None] Create snapshot completed successfully
Nov 03 17:01:26 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772 1073741824" returned: 0 in 0.510s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:26 devstack sudo[98184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772
Nov 03 17:01:26 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:26 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772" returned: 0 in 0.358s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ee67da-04d9-448b-94a8-4c7bcb01a345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62bc64f0-8300-4166-965a-ed90e4c78772', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10670e4-d8d8-4e10-bc2c-afc0009e7d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Volume volume-62bc64f0-8300-4166-965a-ed90e4c78772 (62bc64f0-8300-4166-965a-ed90e4c78772): created successfully
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10670e4-d8d8-4e10-bc2c-afc0009e7d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Flow 'volume_create_manager' (fbef74d1-b670-4815-a476-46e988a66d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:01:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fa7fe63d-047f-4f1c-92e4-9df13ad2cd19 tempest-GroupSnapshotsV319Test-159072194 None] Created volume successfully.
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] Creating offline snapshot 02aa2803-581f-4aa2-b59c-59d7abc9a7b1 of volume 44aaa6a2-c103-46de-8265-c5717598fc09 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[433d00c8-1183-4715-8f35-9769a1da6efc]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:26 devstack sudo[98202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37
Nov 03 17:01:26 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] GroupSnapshot 7a9a1829-f954-4132-b952-af77f2fdcc27: creating.
Nov 03 17:01:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-d2b6225a-4c97-44b8-9e8a-e217e4eff32b req-76addda8-4613-4be8-857e-b94e04357e70 tempest-TestShelveInstance-1659701464 None] Terminate volume connection completed successfully.
Nov 03 17:01:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-d2b6225a-4c97-44b8-9e8a-e217e4eff32b req-76addda8-4613-4be8-857e-b94e04357e70 tempest-TestShelveInstance-1659701464 None] Deleting attachment dc1e9d54-26ab-484c-a09a-fd1590791d9f. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:01:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] Group snapshot 7a9a1829-f954-4132-b952-af77f2fdcc27: creating. {{(pid=87122) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 17:01:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:27 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37" returned: 0 in 0.549s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44aaa6a2-c103-46de-8265-c5717598fc09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:01:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:27 devstack sudo[98212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 1G
Nov 03 17:01:27 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:28 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 1G" returned: 0 in 0.702s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:28 devstack sudo[98219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1
Nov 03 17:01:28 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:28 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1" returned: 0 in 0.337s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:28 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 is being set with open permissions: ugo+rw
Nov 03 17:01:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:28 devstack sudo[98224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1
Nov 03 17:01:28 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:28 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1" returned: 0 in 0.244s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.441s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a01bd661-40be-42df-8694-922b7e5645bf tempest-VolumesSnapshotListTestJSON-912485429 None] Create snapshot completed successfully
Nov 03 17:01:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] Creating offline snapshot 90451631-3770-468d-a4f8-998326228d21 of volume 62bc64f0-8300-4166-965a-ed90e4c78772 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:01:28 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1794f0-59fe-4e6e-9301-fdbeb39a835b]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:28 devstack sudo[98227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772
Nov 03 17:01:28 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:29 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772" returned: 0 in 0.412s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:29 devstack sudo[98232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21 1G
Nov 03 17:01:29 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:29 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21 1G" returned: 0 in 0.560s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62bc64f0-8300-4166-965a-ed90e4c78772 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:29 devstack sudo[98240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62bc64f0-8300-4166-965a-ed90e4c78772 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21
Nov 03 17:01:29 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:30 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62bc64f0-8300-4166-965a-ed90e4c78772 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21" returned: 0 in 0.378s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:30 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:01:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:30 devstack sudo[98247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21
Nov 03 17:01:30 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-13a68d2e-0c82-4ef4-a187-c7d7d6ecf165 req-b043ebeb-d95a-4d02-9120-b449151f9dc0 tempest-TestShelveInstance-1659701464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:30 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21" returned: 0 in 0.250s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:30 devstack sudo[98257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.info
Nov 03 17:01:30 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:30 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.info" returned: 0 in 0.256s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:30 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:01:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:30 devstack sudo[98260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.info
Nov 03 17:01:30 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:30 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.info" returned: 0 in 0.228s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.836s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] Creating offline snapshot 1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657 of volume 44aaa6a2-c103-46de-8265-c5717598fc09 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:01:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a095f9-3049-45af-963e-b35f4aec71e0]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:30 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a00b508c-bd15-4bd3-842a-6861574c38a9 tempest-GroupSnapshotsV319Test-159072194 None] group_snapshot 7a9a1829-f954-4132-b952-af77f2fdcc27: created successfully
Nov 03 17:01:31 devstack sudo[98263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1
Nov 03 17:01:31 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:31 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1" returned: 0 in 0.373s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44aaa6a2-c103-46de-8265-c5717598fc09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:31 devstack sudo[98270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657 1G
Nov 03 17:01:31 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Flow 'volume_create_manager' (84410e9a-c631-411f-894e-33477f5bd40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4dfe6ee-9037-4773-a48e-218c14e43ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4dfe6ee-9037-4773-a48e-218c14e43ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-493387463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4f292e-b7e5-4034-9ea4-35d29601e5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243c4155ed1e46dc9b6620a22ce957a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:32Z,use_quota=True,user_id='5a5ca2adbed94aac94986dbe39e3cba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f772e55-90ff-45f9-ac76-fd05f337b10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f772e55-90ff-45f9-ac76-fd05f337b10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e69bb5-e328-4b32-8a5b-5223191343e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e69bb5-e328-4b32-8a5b-5223191343e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4f292e-b7e5-4034-9ea4-35d29601e5ca', 'volume_name': 'volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f95cf1-f7b7-4052-ac6d-a64e99e4ca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f95cf1-f7b7-4052-ac6d-a64e99e4ca56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2269f32-28fc-452c-9dd6-26b85ac1e915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Volume 1f4f292e-b7e5-4034-9ea4-35d29601e5ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca', 'volume_size': 1}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:31 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657 1G" returned: 0 in 0.655s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:31 devstack sudo[98276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657
Nov 03 17:01:31 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] group_snapshot 7a9a1829-f954-4132-b952-af77f2fdcc27: deleting
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] group_snapshot 7a9a1829-f954-4132-b952-af77f2fdcc27: deleting {{(pid=87122) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Acquiring lock "cinder-quobyte-62bc64f0-8300-4166-965a-ed90e4c78772" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Lock "cinder-quobyte-62bc64f0-8300-4166-965a-ed90e4c78772" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Acquiring lock "cinder-quobyte-90451631-3770-468d-a4f8-998326228d21" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Lock "cinder-quobyte-90451631-3770-468d-a4f8-998326228d21" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Deleting offline snapshot 90451631-3770-468d-a4f8-998326228d21 of volume 62bc64f0-8300-4166-965a-ed90e4c78772 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:01:32 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] snapshot_file for this snap is: volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657" returned: 0 in 0.367s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:32 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657 is being set with open permissions: ugo+rw
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e4ac43-b04f-44b6-a298-7631b99d324c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:32 devstack sudo[98281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657
Nov 03 17:01:32 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:32 devstack sudo[98283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21
Nov 03 17:01:32 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:32 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657" returned: 0 in 0.266s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.778s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-13a68d2e-0c82-4ef4-a187-c7d7d6ecf165 req-b043ebeb-d95a-4d02-9120-b449151f9dc0 tempest-TestShelveInstance-1659701464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.377s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-13a68d2e-0c82-4ef4-a187-c7d7d6ecf165 req-b043ebeb-d95a-4d02-9120-b449151f9dc0 tempest-TestShelveInstance-1659701464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-493387463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4f292e-b7e5-4034-9ea4-35d29601e5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243c4155ed1e46dc9b6620a22ce957a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:32Z,use_quota=True,user_id='5a5ca2adbed94aac94986dbe39e3cba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Creating volume 1f4f292e-b7e5-4034-9ea4-35d29601e5ca {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:01:32 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:32 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca 1073741824
Nov 03 17:01:32 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ff9357a2-f1db-4708-b324-b97c5b4262a0 tempest-VolumesSnapshotListTestJSON-912485429 None] Create snapshot completed successfully
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-13a68d2e-0c82-4ef4-a187-c7d7d6ecf165 req-b043ebeb-d95a-4d02-9120-b449151f9dc0 tempest-TestShelveInstance-1659701464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-966d2706-06df-4ce8-9f14-3c966ea5273e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e2e70f9-af69-409b-9e1a-06fba7e7a6c8', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:01:32 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21" returned: 0 in 0.433s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62bc64f0-8300-4166-965a-ed90e4c78772(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a434a-13b5-4167-854b-eacb4a92aeec]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-13a68d2e-0c82-4ef4-a187-c7d7d6ecf165 req-b043ebeb-d95a-4d02-9120-b449151f9dc0 tempest-TestShelveInstance-1659701464 None] attachment_update completed successfully.
Nov 03 17:01:32 devstack sudo[98291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772
Nov 03 17:01:32 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:33 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772" returned: 0 in 0.512s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:33 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca 1073741824" returned: 0 in 0.663s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:33 devstack sudo[98300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21
Nov 03 17:01:33 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:33 devstack sudo[98302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca
Nov 03 17:01:33 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:33 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:01:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2269f32-28fc-452c-9dd6-26b85ac1e915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e9d0fd-c106-4c03-94bf-775abff825a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Volume volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca (1f4f292e-b7e5-4034-9ea4-35d29601e5ca): created successfully
Nov 03 17:01:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e9d0fd-c106-4c03-94bf-775abff825a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Flow 'volume_create_manager' (84410e9a-c631-411f-894e-33477f5bd40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:01:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ec329877-9c98-4302-9b1d-c230bd7eb480 tempest-AttachVolumeTestJSON-1584899401 None] Created volume successfully.
Nov 03 17:01:33 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21" returned: 0 in 0.524s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:33 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21
Nov 03 17:01:33 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:34 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772.90451631-3770-468d-a4f8-998326228d21" returned: 0 in 0.296s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Lock "cinder-quobyte-90451631-3770-468d-a4f8-998326228d21" released by "_delete_snapshot" :: held 1.901s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Lock "cinder-quobyte-62bc64f0-8300-4166-965a-ed90e4c78772" released by "delete_snapshot" :: held 1.929s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:34 devstack cinder-volume[87122]: WARNING cinder.quota [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-886998683 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-886998683, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:01:34 devstack cinder-volume[87122]: WARNING cinder.quota [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-886998683 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-886998683, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] Created reservations ['e5b43dc7-ccd7-4333-9142-7f8f6898220a', '2e38d383-c948-4ac0-9104-b3af58c6d172', 'd5fe3588-d87e-4c53-9bd8-7fa0c09f5b7f', '2e8047dc-da52-4a93-bb08-0bdc14304683'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "cinder-1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "cinder-quobyte-44aaa6a2-c103-46de-8265-c5717598fc09" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-44aaa6a2-c103-46de-8265-c5717598fc09" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "cinder-quobyte-1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Deleting offline snapshot 1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657 of volume 44aaa6a2-c103-46de-8265-c5717598fc09 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] snapshot_file for this snap is: volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:01:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4358d35a-dac2-4b29-bc16-f40000c0ac82 tempest-GroupSnapshotsV319Test-159072194 None] group_snapshot 7a9a1829-f954-4132-b952-af77f2fdcc27: deleted successfully
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[637ea96e-a8cf-4a32-bf47-e5bf7e47480a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:34 devstack sudo[98312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657
Nov 03 17:01:34 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Acquiring lock "cinder-quobyte-62bc64f0-8300-4166-965a-ed90e4c78772" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Lock "cinder-quobyte-62bc64f0-8300-4166-965a-ed90e4c78772" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:35 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe6169f-933e-4d8b-8868-95149753b890]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657" returned: 0 in 0.580s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44aaa6a2-c103-46de-8265-c5717598fc09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:01:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4ea829-a811-41d3-a0c5-319db41c0147]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:35 devstack sudo[98318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772
Nov 03 17:01:35 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:35 devstack sudo[98322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1
Nov 03 17:01:35 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:35 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772" returned: 0 in 0.491s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:35 devstack sudo[98332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772
Nov 03 17:01:35 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:35 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1" returned: 0 in 0.472s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44aaa6a2-c103-46de-8265-c5717598fc09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:01:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:35 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657
Nov 03 17:01:35 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:35 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-62bc64f0-8300-4166-965a-ed90e4c78772" returned: 0 in 0.463s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Lock "cinder-quobyte-62bc64f0-8300-4166-965a-ed90e4c78772" released by "delete_volume" :: held 1.058s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Created reservations ['5e0ea3ef-0f28-433f-aa03-5f886a558dc1'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-3f72ceb1-cf46-478b-bb7e-59a98967dc96 req-f2240c9e-f3f3-41c0-be87-0d29d553debe tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-3f72ceb1-cf46-478b-bb7e-59a98967dc96 req-f2240c9e-f3f3-41c0-be87-0d29d553debe tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-3f72ceb1-cf46-478b-bb7e-59a98967dc96 req-f2240c9e-f3f3-41c0-be87-0d29d553debe tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:36 devstack cinder-volume[87122]: WARNING cinder.quota [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-886998683 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-886998683, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:01:36 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Created reservations ['d587b704-4a73-40f9-a7ae-bfc95cbd0849', 'afa0f52e-a29b-4a1e-88a6-50da8ebcc254', '15b1a684-2912-4d78-ba6f-1c5b9066382e', 'c3e1fee6-5ff8-4234-96f4-6fef6a75dbcc'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657" returned: 0 in 0.765s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-3f72ceb1-cf46-478b-bb7e-59a98967dc96 req-f2240c9e-f3f3-41c0-be87-0d29d553debe tempest-AttachVolumeTestJSON-1584899401 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80147309-cc2e-4e89-8db9-76f540941163', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:01:36 devstack sudo[98457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657
Nov 03 17:01:36 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-3f72ceb1-cf46-478b-bb7e-59a98967dc96 req-f2240c9e-f3f3-41c0-be87-0d29d553debe tempest-AttachVolumeTestJSON-1584899401 None] attachment_update completed successfully.
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:36 devstack sudo[98686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:01:36 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:36 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657" returned: 0 in 0.631s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657" released by "_delete_snapshot" :: held 2.616s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-44aaa6a2-c103-46de-8265-c5717598fc09" released by "delete_snapshot" :: held 2.655s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Created reservations ['6834a919-859c-4a7e-95e4-2912181592d2', '5bc855ec-9cd2-407a-a84f-c1ae183531c4', '2a0fbd26-fa31-454b-9382-528ee249f2c6', 'd8d137ea-f4cd-4ed3-a3ae-e426fe6df3d5'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:01:37 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.519s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:01:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-87db80a3-2339-4efc-9340-b2b992d7cfec tempest-GroupSnapshotsV319Test-159072194 None] Delete group completed successfully.
Nov 03 17:01:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Delete snapshot completed successfully.
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f45622f-1319-4ec5-9c7d-32dae8a7e346 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-1eb9d16d-10dd-4e92-8f90-8a4d1e2b0657-delete_snapshot" released by "delete_snapshot" :: held 2.971s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "cinder-02aa2803-581f-4aa2-b59c-59d7abc9a7b1-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-02aa2803-581f-4aa2-b59c-59d7abc9a7b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "cinder-quobyte-44aaa6a2-c103-46de-8265-c5717598fc09" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-44aaa6a2-c103-46de-8265-c5717598fc09" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "cinder-quobyte-02aa2803-581f-4aa2-b59c-59d7abc9a7b1" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-02aa2803-581f-4aa2-b59c-59d7abc9a7b1" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Deleting offline snapshot 02aa2803-581f-4aa2-b59c-59d7abc9a7b1 of volume 44aaa6a2-c103-46de-8265-c5717598fc09 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] snapshot_file for this snap is: volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70aacb9-d17b-4e97-931e-491f6fa96563]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:38 devstack sudo[98837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1
Nov 03 17:01:38 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:38 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1" returned: 0 in 0.509s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44aaa6a2-c103-46de-8265-c5717598fc09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:01:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[442aa0ff-7224-4e51-85eb-8e38a4acb28e]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:38 devstack sudo[98842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37
Nov 03 17:01:38 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:01:39 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Flow 'volume_create_manager' (a37ad04f-a722-46f6-94b0-13e658f0d512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49dc734-c4ec-4136-af1e-0ec4dd497ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37" returned: 0 in 0.731s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44aaa6a2-c103-46de-8265-c5717598fc09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:39 devstack sudo[98849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1
Nov 03 17:01:39 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49dc734-c4ec-4136-af1e-0ec4dd497ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-462265455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=056420e5-5bf4-4850-97ec-ee3b82ff8118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243c4155ed1e46dc9b6620a22ce957a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:39Z,use_quota=True,user_id='5a5ca2adbed94aac94986dbe39e3cba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f7dc18-b5ac-490e-854a-952d37a4084d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f7dc18-b5ac-490e-854a-952d37a4084d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877e8aec-e2dd-4cf8-8ecb-53ddfb5c6375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877e8aec-e2dd-4cf8-8ecb-53ddfb5c6375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '056420e5-5bf4-4850-97ec-ee3b82ff8118', 'volume_name': 'volume-056420e5-5bf4-4850-97ec-ee3b82ff8118', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5840d755-69f4-4a76-a957-01452c567a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5840d755-69f4-4a76-a957-01452c567a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670cb87f-f483-469c-883d-ec9e6f1e2685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Volume 056420e5-5bf4-4850-97ec-ee3b82ff8118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-056420e5-5bf4-4850-97ec-ee3b82ff8118', 'volume_size': 1}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-462265455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=056420e5-5bf4-4850-97ec-ee3b82ff8118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243c4155ed1e46dc9b6620a22ce957a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:39Z,use_quota=True,user_id='5a5ca2adbed94aac94986dbe39e3cba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Creating volume 056420e5-5bf4-4850-97ec-ee3b82ff8118 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:01:39 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-056420e5-5bf4-4850-97ec-ee3b82ff8118 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:39 devstack sudo[98851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-056420e5-5bf4-4850-97ec-ee3b82ff8118 1073741824
Nov 03 17:01:39 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:39 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1" returned: 0 in 0.487s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:39 devstack sudo[98859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1
Nov 03 17:01:39 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:40 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-056420e5-5bf4-4850-97ec-ee3b82ff8118 1073741824" returned: 0 in 0.716s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-056420e5-5bf4-4850-97ec-ee3b82ff8118 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:40 devstack sudo[98862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-056420e5-5bf4-4850-97ec-ee3b82ff8118
Nov 03 17:01:40 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:40 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.02aa2803-581f-4aa2-b59c-59d7abc9a7b1" returned: 0 in 0.500s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-02aa2803-581f-4aa2-b59c-59d7abc9a7b1" released by "_delete_snapshot" :: held 2.431s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-44aaa6a2-c103-46de-8265-c5717598fc09" released by "delete_snapshot" :: held 2.478s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Created reservations ['782174b1-13a8-47f1-a8c7-fc5a5ffed692', '39a53e94-58b1-443f-b26a-e9de0c27dbeb', '6485ea39-08ad-45c3-884e-be3d37e9cdee', '7a7f8cec-183c-4eb2-9b7b-7970d8b2cdc2'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:01:40 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-056420e5-5bf4-4850-97ec-ee3b82ff8118" returned: 0 in 0.312s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670cb87f-f483-469c-883d-ec9e6f1e2685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-056420e5-5bf4-4850-97ec-ee3b82ff8118', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0a2d91-3f81-4e8d-ba3b-5b09b039c9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Delete snapshot completed successfully.
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33cfad98-d034-4113-b73e-79878aa48e2a tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-02aa2803-581f-4aa2-b59c-59d7abc9a7b1-delete_snapshot" released by "delete_snapshot" :: held 2.777s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Volume volume-056420e5-5bf4-4850-97ec-ee3b82ff8118 (056420e5-5bf4-4850-97ec-ee3b82ff8118): created successfully
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0a2d91-3f81-4e8d-ba3b-5b09b039c9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Flow 'volume_create_manager' (a37ad04f-a722-46f6-94b0-13e658f0d512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:01:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2d44de78-6c6c-482e-b1b5-739d831a8c5d tempest-AttachVolumeTestJSON-1584899401 None] Created volume successfully.
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "cinder-b8c9c102-b57e-4144-b361-8731a5c8ce37-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-b8c9c102-b57e-4144-b361-8731a5c8ce37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "cinder-quobyte-44aaa6a2-c103-46de-8265-c5717598fc09" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-44aaa6a2-c103-46de-8265-c5717598fc09" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "cinder-quobyte-b8c9c102-b57e-4144-b361-8731a5c8ce37" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-b8c9c102-b57e-4144-b361-8731a5c8ce37" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Deleting offline snapshot b8c9c102-b57e-4144-b361-8731a5c8ce37 of volume 44aaa6a2-c103-46de-8265-c5717598fc09 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] snapshot_file for this snap is: volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d80b9a-41c3-4443-b8f0-5a9c92b414d2]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:41 devstack sudo[98868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37
Nov 03 17:01:41 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:41 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37" returned: 0 in 0.492s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44aaa6a2-c103-46de-8265-c5717598fc09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e54429-1451-420e-9cdc-8ad91bda20d8]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:42 devstack sudo[98876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09
Nov 03 17:01:42 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-113c7fd9-9076-4001-9cb4-4d8993d06680 req-8d21eaf3-2eb9-4353-8e02-db7dfb44e2cb tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-113c7fd9-9076-4001-9cb4-4d8993d06680 req-8d21eaf3-2eb9-4353-8e02-db7dfb44e2cb tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-113c7fd9-9076-4001-9cb4-4d8993d06680 req-8d21eaf3-2eb9-4353-8e02-db7dfb44e2cb tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-113c7fd9-9076-4001-9cb4-4d8993d06680 req-8d21eaf3-2eb9-4353-8e02-db7dfb44e2cb tempest-AttachVolumeTestJSON-1584899401 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-056420e5-5bf4-4850-97ec-ee3b82ff8118', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb951f29-3920-4680-926b-aa661871d5f3', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:01:42 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09" returned: 0 in 0.694s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:42 devstack sudo[98889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37
Nov 03 17:01:42 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-113c7fd9-9076-4001-9cb4-4d8993d06680 req-8d21eaf3-2eb9-4353-8e02-db7dfb44e2cb tempest-AttachVolumeTestJSON-1584899401 None] attachment_update completed successfully.
Nov 03 17:01:43 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37" returned: 0 in 0.599s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:43 devstack sudo[98899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37
Nov 03 17:01:43 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:43 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09.b8c9c102-b57e-4144-b361-8731a5c8ce37" returned: 0 in 0.469s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-b8c9c102-b57e-4144-b361-8731a5c8ce37" released by "_delete_snapshot" :: held 2.450s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-44aaa6a2-c103-46de-8265-c5717598fc09" released by "delete_snapshot" :: held 2.479s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:43 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Created reservations ['14796e81-4a26-4a1a-a727-eed46c0ecf37', '83b37102-9697-4635-b477-5e9ddf3be04a', 'aca2851d-d700-4d37-af8f-48aafbdb9a4d', '4f9841f6-fa8d-46ab-8e0c-1e7a90b79a1d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:01:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Delete snapshot completed successfully.
Nov 03 17:01:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d7a9483-fbbe-47f0-8c08-fb48a973bd30 tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-b8c9c102-b57e-4144-b361-8731a5c8ce37-delete_snapshot" released by "delete_snapshot" :: held 2.688s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "cinder-44aaa6a2-c103-46de-8265-c5717598fc09-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-44aaa6a2-c103-46de-8265-c5717598fc09-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "cinder-quobyte-44aaa6a2-c103-46de-8265-c5717598fc09" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-44aaa6a2-c103-46de-8265-c5717598fc09" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:44 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a554ab9-099b-40b9-8dd6-4f069f9d67cb]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:44 devstack sudo[98905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09
Nov 03 17:01:44 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:45 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09" returned: 0 in 0.527s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:45 devstack sudo[98910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09
Nov 03 17:01:45 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:45 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-44aaa6a2-c103-46de-8265-c5717598fc09" returned: 0 in 0.294s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-quobyte-44aaa6a2-c103-46de-8265-c5717598fc09" released by "delete_volume" :: held 0.920s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:45 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Created reservations ['d8c8befe-18dd-4788-b916-d77ec92e42c9', '76103c19-f313-4bfa-8d66-4b877838f772', '44af0e44-66e0-481e-97c9-27afd1fee62b', '467490ec-31c8-4f82-b7e1-58a6f1324b1f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:01:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-f111bdd0-458c-4892-bf97-3a1e570d54e8 req-a57563b1-a43b-4b33-8b2d-963b282ecf68 tempest-AttachVolumeTestJSON-1584899401 None] Terminate volume connection completed successfully.
Nov 03 17:01:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f111bdd0-458c-4892-bf97-3a1e570d54e8 req-a57563b1-a43b-4b33-8b2d-963b282ecf68 tempest-AttachVolumeTestJSON-1584899401 None] Deleting attachment 80147309-cc2e-4e89-8db9-76f540941163. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:01:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:45 devstack sudo[98915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:01:45 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:46 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.366s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:46 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:01:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Deleted volume successfully.
Nov 03 17:01:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-275fec59-6000-46f2-afc0-1bb9a344734d tempest-VolumesSnapshotListTestJSON-912485429 None] Lock "cinder-44aaa6a2-c103-46de-8265-c5717598fc09-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8e2ea0ac-8eff-4da1-9d6a-2f72e916780f tempest-GroupsV314Test-177909556 None] Group tempest-GroupsV314Test-Group-2047644416: creating
Nov 03 17:01:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8e2ea0ac-8eff-4da1-9d6a-2f72e916780f tempest-GroupsV314Test-177909556 None] Group tempest-GroupsV314Test-Group-2047644416: created successfully
Nov 03 17:01:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8e2ea0ac-8eff-4da1-9d6a-2f72e916780f tempest-GroupsV314Test-177909556 None] Create group completed successfully.
Nov 03 17:01:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-a3cf9949-515e-438f-a3c5-30bdb62f6f9a req-4247949f-a4bd-4c91-a4be-8c563906a2d4 tempest-AttachVolumeTestJSON-1584899401 None] Terminate volume connection completed successfully.
Nov 03 17:01:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a3cf9949-515e-438f-a3c5-30bdb62f6f9a req-4247949f-a4bd-4c91-a4be-8c563906a2d4 tempest-AttachVolumeTestJSON-1584899401 None] Deleting attachment eb951f29-3920-4680-926b-aa661871d5f3. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Flow 'volume_create_manager' (ecb0ff86-00b5-44f6-b0fe-ef12813ab2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6114776-c1e7-4c24-a5aa-3525ec049c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6114776-c1e7-4c24-a5aa-3525ec049c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-327530583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b4a3ed47-3a5d-407e-aa2c-2958dab085e8,host='devstack@QuobyteHD#QuobyteHD',id=3290b767-0ac4-46a3-b077-e80a7217e887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b9d95c7ec74e7e9341062951165982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:48Z,use_quota=True,user_id='36b7fc5dd9e14caa811f5cce9c3981d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7549d616-56d4-4615-b554-7a6c35c8a8c3),volume_type_id=7549d616-56d4-4615-b554-7a6c35c8a8c3)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5602e56-89c7-4aa4-bc51-a3e8982c5638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5602e56-89c7-4aa4-bc51-a3e8982c5638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ef184f-1138-4d07-b18e-403d6f503ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ef184f-1138-4d07-b18e-403d6f503ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3290b767-0ac4-46a3-b077-e80a7217e887', 'volume_name': 'volume-3290b767-0ac4-46a3-b077-e80a7217e887', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e025c6b1-29aa-4d3c-8e28-8416e86f3d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e025c6b1-29aa-4d3c-8e28-8416e86f3d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e162442-a21f-414e-ac03-55792c216d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:48 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Volume 3290b767-0ac4-46a3-b077-e80a7217e887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3290b767-0ac4-46a3-b077-e80a7217e887', 'volume_size': 1}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b4a3ed47-3a5d-407e-aa2c-2958dab085e8,created_at=2026-11-03T16:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-327530583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b4a3ed47-3a5d-407e-aa2c-2958dab085e8,host='devstack@QuobyteHD#QuobyteHD',id=3290b767-0ac4-46a3-b077-e80a7217e887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b9d95c7ec74e7e9341062951165982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:48Z,use_quota=True,user_id='36b7fc5dd9e14caa811f5cce9c3981d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7549d616-56d4-4615-b554-7a6c35c8a8c3),volume_type_id=7549d616-56d4-4615-b554-7a6c35c8a8c3)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Creating volume 3290b767-0ac4-46a3-b077-e80a7217e887 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:01:48 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:01:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:48 devstack sudo[98921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887 1073741824
Nov 03 17:01:48 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:49 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887 1073741824" returned: 0 in 0.775s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:49 devstack sudo[98937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887
Nov 03 17:01:49 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:50 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887" returned: 0 in 0.685s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:01:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e162442-a21f-414e-ac03-55792c216d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3290b767-0ac4-46a3-b077-e80a7217e887', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4de859-8acb-424e-a113-3e6701d37d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:01:50 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Volume volume-3290b767-0ac4-46a3-b077-e80a7217e887 (3290b767-0ac4-46a3-b077-e80a7217e887): created successfully
Nov 03 17:01:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4de859-8acb-424e-a113-3e6701d37d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:01:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Flow 'volume_create_manager' (ecb0ff86-00b5-44f6-b0fe-ef12813ab2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:01:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5fcdb456-d1d9-46be-94df-7d16fd8669b5 tempest-GroupsV314Test-177909556 None] Created volume successfully.
Nov 03 17:01:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:01:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:51 devstack sudo[98955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:01:51 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:52 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.433s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:01:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:01:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:01:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:01:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:52 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Cloning volume 3290b767-0ac4-46a3-b077-e80a7217e887 to volume f41fac99-6f1d-45e7-9285-9dc6ed3255ef
Nov 03 17:01:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Creating offline snapshot 037bae01-d0ff-40c5-a594-a0b16782a82f of volume 3290b767-0ac4-46a3-b077-e80a7217e887 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:01:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[518923fb-06d2-420d-a303-9a2dbfae9311]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:52 devstack sudo[98958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887
Nov 03 17:01:52 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:53 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887" returned: 0 in 0.626s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:53 devstack sudo[98963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f 1G
Nov 03 17:01:53 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:53 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f 1G" returned: 0 in 0.678s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3290b767-0ac4-46a3-b077-e80a7217e887 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:53 devstack sudo[98969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3290b767-0ac4-46a3-b077-e80a7217e887 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f
Nov 03 17:01:53 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "cinder-056420e5-5bf4-4850-97ec-ee3b82ff8118-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Lock "cinder-056420e5-5bf4-4850-97ec-ee3b82ff8118-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "cinder-quobyte-056420e5-5bf4-4850-97ec-ee3b82ff8118" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Lock "cinder-quobyte-056420e5-5bf4-4850-97ec-ee3b82ff8118" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:54 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05a17ff-a448-4a80-abd2-4e7dc9c493d9]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-056420e5-5bf4-4850-97ec-ee3b82ff8118 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:54 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3290b767-0ac4-46a3-b077-e80a7217e887 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f" returned: 0 in 0.479s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:54 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:01:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:54 devstack sudo[98975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f
Nov 03 17:01:54 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:54 devstack sudo[98974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-056420e5-5bf4-4850-97ec-ee3b82ff8118
Nov 03 17:01:54 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:54 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:54 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=89,cinder:INSERT=20,cinder:DELETE=5,cinder:SELECT=107 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:01:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:54 devstack sudo[98979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.info
Nov 03 17:01:54 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:54 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-056420e5-5bf4-4850-97ec-ee3b82ff8118" returned: 0 in 0.634s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-056420e5-5bf4-4850-97ec-ee3b82ff8118 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:54 devstack sudo[98984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-056420e5-5bf4-4850-97ec-ee3b82ff8118
Nov 03 17:01:54 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:55 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.info" returned: 0 in 0.396s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:55 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:55 devstack sudo[98988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.info
Nov 03 17:01:55 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:55 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-056420e5-5bf4-4850-97ec-ee3b82ff8118" returned: 0 in 0.372s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Lock "cinder-quobyte-056420e5-5bf4-4850-97ec-ee3b82ff8118" released by "delete_volume" :: held 1.070s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=100,cinder:UPDATE=88,cinder:INSERT=23,cinder:DELETE=7 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Created reservations ['9fdbd70b-3ae6-4463-9320-755363e650a6', '9d0fd556-81c5-4893-b198-be4cc7537653', '28834720-c8af-4c05-b85d-179925355e14', '70c5d0fe-1dae-497c-bc74-1e54065badef'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:01:55 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.info" returned: 0 in 0.320s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Acquiring lock "cinder-quobyte-f41fac99-6f1d-45e7-9285-9dc6ed3255ef" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Lock "cinder-quobyte-f41fac99-6f1d-45e7-9285-9dc6ed3255ef" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] snapshot: 037bae01-d0ff-40c5-a594-a0b16782a82f, volume: f41fac99-6f1d-45e7-9285-9dc6ed3255ef,  {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f685d6e6-27e5-4d30-af4f-b76126dd859a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:55 devstack sudo[98994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:01:55 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:55 devstack sudo[98995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f
Nov 03 17:01:55 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:55 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.427s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:01:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Deleted volume successfully.
Nov 03 17:01:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-41d50134-4d46-41f4-b83c-9014482a6cdc tempest-AttachVolumeTestJSON-1584899401 None] Lock "cinder-056420e5-5bf4-4850-97ec-ee3b82ff8118-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:56 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f" returned: 0 in 0.541s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3290b767-0ac4-46a3-b077-e80a7217e887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea97740f-e82d-4720-8e6a-3a1fef12e1a6]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:56 devstack sudo[99027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887
Nov 03 17:01:56 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "cinder-1f4f292e-b7e5-4034-9ea4-35d29601e5ca-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Lock "cinder-1f4f292e-b7e5-4034-9ea4-35d29601e5ca-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "cinder-quobyte-1f4f292e-b7e5-4034-9ea4-35d29601e5ca" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Lock "cinder-quobyte-1f4f292e-b7e5-4034-9ea4-35d29601e5ca" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a2f4a4-10ee-4f67-8c01-985f32fe4b57]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:56 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Path /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:56 devstack sudo[99033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef
Nov 03 17:01:56 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:56 devstack sudo[99032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca
Nov 03 17:01:56 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:56 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca" returned: 0 in 0.407s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:56 devstack sudo[99042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca
Nov 03 17:01:56 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:57 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1f4f292e-b7e5-4034-9ea4-35d29601e5ca" returned: 0 in 0.487s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Lock "cinder-quobyte-1f4f292e-b7e5-4034-9ea4-35d29601e5ca" released by "delete_volume" :: held 0.979s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:57 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Created reservations ['613dc060-506a-4276-89ff-0dcfafbc5068', 'e531f5c2-4aea-4a9b-ba50-bc057c9c42e9', '1bd3e2e2-3587-442b-a7b1-6a2cef84578c', 'ade5947e-a97e-4340-a444-ffb87e3806e4'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:01:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:01:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:01:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:01:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:01:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:01:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:57 devstack sudo[99052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:01:57 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:01:58 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root
Nov 03 17:01:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.623s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:01:58 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:01:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Deleted volume successfully.
Nov 03 17:01:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7947df67-3b80-4a47-9b2c-c290f56454e2 tempest-AttachVolumeTestJSON-1584899401 None] Lock "cinder-1f4f292e-b7e5-4034-9ea4-35d29601e5ca-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:01:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "cinder-d95f234f-f158-48c2-a325-1072eaba98a1-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Lock "cinder-d95f234f-f158-48c2-a325-1072eaba98a1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "cinder-quobyte-d95f234f-f158-48c2-a325-1072eaba98a1" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:01:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Lock "cinder-quobyte-d95f234f-f158-48c2-a325-1072eaba98a1" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:01:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[507ea433-c9b6-4981-b606-3f20778e1bc1]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:01:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d95f234f-f158-48c2-a325-1072eaba98a1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:01:59 devstack sudo[99056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d95f234f-f158-48c2-a325-1072eaba98a1
Nov 03 17:01:59 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:00 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d95f234f-f158-48c2-a325-1072eaba98a1" returned: 0 in 1.093s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d95f234f-f158-48c2-a325-1072eaba98a1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:00 devstack sudo[99062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d95f234f-f158-48c2-a325-1072eaba98a1
Nov 03 17:02:00 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:00 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d95f234f-f158-48c2-a325-1072eaba98a1" returned: 0 in 0.660s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Lock "cinder-quobyte-d95f234f-f158-48c2-a325-1072eaba98a1" released by "delete_volume" :: held 1.917s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:01 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Created reservations ['915c022c-65e4-4f22-b35e-6982b3bbb677', 'ebaeb69d-83de-4621-82ee-9b21e4c8cf10', '79af5d0b-62c9-407e-ae41-082d423b4efa', '97b10e50-30d5-4268-9e48-3cfb0580eb5a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:02:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:01 devstack sudo[99065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:02:01 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:01 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.525s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:02 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:02:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Deleted volume successfully.
Nov 03 17:02:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b3d8d04a-f66b-4ebe-ac00-4266bb1a3f2b tempest-AttachVolumeTestJSON-1584899401 None] Lock "cinder-d95f234f-f158-48c2-a325-1072eaba98a1-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef" returned: 0 in 8.574s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:02:05 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Converted 1024.00 MB image at 119.42 MB/s
Nov 03 17:02:05 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:05 devstack sudo[99068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef
Nov 03 17:02:05 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:05 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef" returned: 0 in 0.317s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Lock "cinder-quobyte-f41fac99-6f1d-45e7-9285-9dc6ed3255ef" released by "_copy_volume_from_snapshot" :: held 9.968s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Acquiring lock "cinder-quobyte-037bae01-d0ff-40c5-a594-a0b16782a82f" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Lock "cinder-quobyte-037bae01-d0ff-40c5-a594-a0b16782a82f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Deleting offline snapshot 037bae01-d0ff-40c5-a594-a0b16782a82f of volume 3290b767-0ac4-46a3-b077-e80a7217e887 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] snapshot_file for this snap is: volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c895be3-30b3-4450-b0eb-3d3f88988cf5]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:05 devstack sudo[99072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f
Nov 03 17:02:05 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:05 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f" returned: 0 in 0.465s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3290b767-0ac4-46a3-b077-e80a7217e887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cd46d7-7bcc-4799-9935-a40821c62979]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:02:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:06 devstack sudo[99078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887
Nov 03 17:02:06 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:06 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887" returned: 0 in 0.767s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:06 devstack sudo[99083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f
Nov 03 17:02:06 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:07 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f" returned: 0 in 0.561s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:07 devstack sudo[99089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f
Nov 03 17:02:07 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:07 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887.037bae01-d0ff-40c5-a594-a0b16782a82f" returned: 0 in 0.300s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Lock "cinder-quobyte-037bae01-d0ff-40c5-a594-a0b16782a82f" released by "_delete_snapshot" :: held 2.258s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.412s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-aab70dd6-1782-4bcf-b5ab-2bf694836c96 tempest-GroupsV314Test-177909556 None] Create group from source-group-b4a3ed47-3a5d-407e-aa2c-2958dab085e8 completed successfully.
Nov 03 17:02:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Acquiring lock "cinder-quobyte-f41fac99-6f1d-45e7-9285-9dc6ed3255ef" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:02:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Lock "cinder-quobyte-f41fac99-6f1d-45e7-9285-9dc6ed3255ef" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:02:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c5ad38-3e3d-4dd0-98e2-5a4acf56e314]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:02:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:09 devstack sudo[99093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef
Nov 03 17:02:09 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:09 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef" returned: 0 in 0.426s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:09 devstack sudo[99104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef
Nov 03 17:02:09 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:09 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f41fac99-6f1d-45e7-9285-9dc6ed3255ef" returned: 0 in 0.288s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Lock "cinder-quobyte-f41fac99-6f1d-45e7-9285-9dc6ed3255ef" released by "delete_volume" :: held 0.770s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:09 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Created reservations ['9236d806-dc4c-4164-8c59-3606d7d05234'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:02:09 devstack cinder-volume[87122]: WARNING cinder.quota [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1859314286 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1859314286, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:02:09 devstack cinder-volume[87122]: WARNING cinder.quota [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1859314286 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1859314286, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:02:10 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Created reservations ['eef08972-238d-41bf-b3b1-11a764221946', '034d053c-54f7-499f-a67c-4cef8ba99da4', '2b6007cb-0bd3-4bd2-9dd0-616cea1581b2', 'efc63eee-59bd-44b9-9182-344f81ebfba9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:02:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:10 devstack sudo[99107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:02:10 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:10 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.370s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:10 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:02:10 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-48dc6b90-5f6f-4912-8867-58502544e080 tempest-GroupsV314Test-177909556 None] Delete group completed successfully.
Nov 03 17:02:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Acquiring lock "cinder-quobyte-3290b767-0ac4-46a3-b077-e80a7217e887" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:02:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Lock "cinder-quobyte-3290b767-0ac4-46a3-b077-e80a7217e887" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:02:10 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae095abd-9108-484d-ae62-61ed68987f49]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:02:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:10 devstack sudo[99111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887
Nov 03 17:02:10 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:11 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887" returned: 0 in 0.424s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:11 devstack sudo[99116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887
Nov 03 17:02:11 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:11 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3290b767-0ac4-46a3-b077-e80a7217e887" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Lock "cinder-quobyte-3290b767-0ac4-46a3-b077-e80a7217e887" released by "delete_volume" :: held 0.788s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:11 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Created reservations ['91e558a7-c13f-4b5a-b2e2-094e937e6f59'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:02:11 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Created reservations ['a13db2b8-781e-41ad-8419-7220292b0398', '359455b5-a63a-4912-ab7e-19aeebcbc529', '819d6c42-81b0-4fe4-b797-9da8ecfa2af0', '020e7bc5-8818-43e1-8e64-6bcbdc5ac90c'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:02:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:11 devstack sudo[99120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:02:11 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:12 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.383s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:12 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:02:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-84f9a30d-e4b3-4b3b-9292-2a7a33e68f87 tempest-GroupsV314Test-177909556 None] Delete group completed successfully.
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Flow 'volume_create_manager' (ade321d3-ea3d-40d2-a95b-ae04db7a8afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7a3dd5-6f0c-406f-a147-cf6ab120d727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7a3dd5-6f0c-406f-a147-cf6ab120d727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-374488422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e231d6c1-4d93-4147-b6d3-371ba3846c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c76d02844354430a447f15db23fc3cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:20Z,use_quota=True,user_id='f013077d8a59463ba68a4b05667827c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62adcb91-f438-4e35-883f-8810ba7b4cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62adcb91-f438-4e35-883f-8810ba7b4cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2e1da9-780f-45ff-af8c-1f361bc92429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2e1da9-780f-45ff-af8c-1f361bc92429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e231d6c1-4d93-4147-b6d3-371ba3846c11', 'volume_name': 'volume-e231d6c1-4d93-4147-b6d3-371ba3846c11', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e791ad-9732-4758-849a-f063c2a2ea08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e791ad-9732-4758-849a-f063c2a2ea08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3ddec6-cee5-4ece-9096-15b2690b30f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Volume e231d6c1-4d93-4147-b6d3-371ba3846c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e231d6c1-4d93-4147-b6d3-371ba3846c11', 'volume_size': 1}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-374488422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e231d6c1-4d93-4147-b6d3-371ba3846c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c76d02844354430a447f15db23fc3cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:20Z,use_quota=True,user_id='f013077d8a59463ba68a4b05667827c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Creating volume e231d6c1-4d93-4147-b6d3-371ba3846c11 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:02:19 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:02:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e231d6c1-4d93-4147-b6d3-371ba3846c11 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:20 devstack sudo[99163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e231d6c1-4d93-4147-b6d3-371ba3846c11 1073741824
Nov 03 17:02:20 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:20 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:02:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Flow 'volume_create_manager' (e2335a96-9f0e-455c-bf43-ece18b4cf555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:02:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337b0638-a920-41a7-9a6d-87e5bd23ae11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337b0638-a920-41a7-9a6d-87e5bd23ae11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-655793750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6192a520-613c-45db-80c5-047b483bb61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c76d02844354430a447f15db23fc3cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:21Z,use_quota=True,user_id='f013077d8a59463ba68a4b05667827c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467d2cf6-3467-42b5-a039-eee385831372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467d2cf6-3467-42b5-a039-eee385831372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:20 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19c9f3c-5e80-4518-a93a-7b12dff981ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19c9f3c-5e80-4518-a93a-7b12dff981ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6192a520-613c-45db-80c5-047b483bb61f', 'volume_name': 'volume-6192a520-613c-45db-80c5-047b483bb61f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd00ccb-5547-4a53-b199-b30c393c26cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd00ccb-5547-4a53-b199-b30c393c26cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b30e784-e5ce-4a1a-aa85-0ef26ae106a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Volume 6192a520-613c-45db-80c5-047b483bb61f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6192a520-613c-45db-80c5-047b483bb61f', 'volume_size': 1}
Nov 03 17:02:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e231d6c1-4d93-4147-b6d3-371ba3846c11 1073741824" returned: 0 in 1.023s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e231d6c1-4d93-4147-b6d3-371ba3846c11 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:21 devstack sudo[99174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e231d6c1-4d93-4147-b6d3-371ba3846c11
Nov 03 17:02:21 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:21 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e231d6c1-4d93-4147-b6d3-371ba3846c11" returned: 0 in 0.591s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-655793750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6192a520-613c-45db-80c5-047b483bb61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c76d02844354430a447f15db23fc3cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:21Z,use_quota=True,user_id='f013077d8a59463ba68a4b05667827c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Creating volume 6192a520-613c-45db-80c5-047b483bb61f {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:02:21 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6192a520-613c-45db-80c5-047b483bb61f 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:21 devstack sudo[99195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6192a520-613c-45db-80c5-047b483bb61f 1073741824
Nov 03 17:02:21 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3ddec6-cee5-4ece-9096-15b2690b30f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e231d6c1-4d93-4147-b6d3-371ba3846c11', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800bc659-d862-44f8-b75e-1caf30362982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:21 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Volume volume-e231d6c1-4d93-4147-b6d3-371ba3846c11 (e231d6c1-4d93-4147-b6d3-371ba3846c11): created successfully
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800bc659-d862-44f8-b75e-1caf30362982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Flow 'volume_create_manager' (ade321d3-ea3d-40d2-a95b-ae04db7a8afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:02:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-cfec37bb-d5e1-451f-b293-ca1b84aed57b tempest-TestServerVolumeAttachmentScenario-1297117071 None] Created volume successfully.
Nov 03 17:02:22 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6192a520-613c-45db-80c5-047b483bb61f 1073741824" returned: 0 in 1.101s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6192a520-613c-45db-80c5-047b483bb61f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:22 devstack sudo[99202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6192a520-613c-45db-80c5-047b483bb61f
Nov 03 17:02:22 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:23 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6192a520-613c-45db-80c5-047b483bb61f" returned: 0 in 0.572s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:02:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b30e784-e5ce-4a1a-aa85-0ef26ae106a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6192a520-613c-45db-80c5-047b483bb61f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9ad282-ed85-4f4a-b5b8-53ec8bc5718d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Volume volume-6192a520-613c-45db-80c5-047b483bb61f (6192a520-613c-45db-80c5-047b483bb61f): created successfully
Nov 03 17:02:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9ad282-ed85-4f4a-b5b8-53ec8bc5718d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Flow 'volume_create_manager' (e2335a96-9f0e-455c-bf43-ece18b4cf555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:02:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b306be7a-d9a1-4159-a5f4-ae91fb1f147a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Created volume successfully.
Nov 03 17:02:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-aedaa4ab-2b13-4e0a-848f-f33a542417d2 tempest-GroupSnapshotsTest-373827168 None] Group tempest-GroupSnapshotsTest-Group-1864196665: creating
Nov 03 17:02:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-aedaa4ab-2b13-4e0a-848f-f33a542417d2 tempest-GroupSnapshotsTest-373827168 None] Group tempest-GroupSnapshotsTest-Group-1864196665: created successfully
Nov 03 17:02:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-362bba65-f0e6-4d46-86c3-1a21b6f1a100 tempest-TestShelveInstance-1659701464 None] Terminate volume connection completed successfully.
Nov 03 17:02:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-362bba65-f0e6-4d46-86c3-1a21b6f1a100 tempest-TestShelveInstance-1659701464 None] Deleting attachment 7e2e70f9-af69-409b-9e1a-06fba7e7a6c8. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:02:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-aedaa4ab-2b13-4e0a-848f-f33a542417d2 tempest-GroupSnapshotsTest-373827168 None] Create group completed successfully.
Nov 03 17:02:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Acquiring lock "cinder-966d2706-06df-4ce8-9f14-3c966ea5273e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:02:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Lock "cinder-966d2706-06df-4ce8-9f14-3c966ea5273e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:02:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Acquiring lock "cinder-quobyte-966d2706-06df-4ce8-9f14-3c966ea5273e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:02:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Lock "cinder-quobyte-966d2706-06df-4ce8-9f14-3c966ea5273e" acquired by "delete_volume" :: waited 0.033s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:02:24 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0111780-36cd-4c00-92cb-11df0152b5e9]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:02:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:25 devstack sudo[99207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e
Nov 03 17:02:25 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:25 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e" returned: 0 in 0.726s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:25 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e
Nov 03 17:02:25 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:26 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-966d2706-06df-4ce8-9f14-3c966ea5273e" returned: 0 in 0.444s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Lock "cinder-quobyte-966d2706-06df-4ce8-9f14-3c966ea5273e" released by "delete_volume" :: held 1.273s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.quota [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Created reservations ['6124bd3f-6ea8-4830-a3ec-826aef0ae4ce', '2d448cc1-a10e-41ff-9834-13956506830d', '1def32c5-2176-4ce9-b2dd-60c8c0f4009c', 'b79462c2-c30c-4205-bcf4-1595102ef48e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:02:26 devstack sudo[99215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:02:26 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Flow 'volume_create_manager' (255973df-5dd0-4ab7-91ea-9d8a65cdcdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6be8a6-31d4-4c2b-b9b6-e178c463382e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6be8a6-31d4-4c2b-b9b6-e178c463382e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-34150333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c768be7e-c250-496e-9bdd-39fd3afce231,host='devstack@QuobyteHD#QuobyteHD',id=0fb57aeb-3b49-45a5-91e1-efb7d226f239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5207ccda5d9468fa0837e296442c935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:26Z,use_quota=True,user_id='1360c9d77a2b4cf79e762aa5537e71f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48ec32e2-fe3d-447f-90f0-62709e7c21ff),volume_type_id=48ec32e2-fe3d-447f-90f0-62709e7c21ff)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41165bdf-5c0c-463d-8619-cb2d26266032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41165bdf-5c0c-463d-8619-cb2d26266032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2d99c7-34df-4556-afad-1fb9390fed02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2d99c7-34df-4556-afad-1fb9390fed02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fb57aeb-3b49-45a5-91e1-efb7d226f239', 'volume_name': 'volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08384449-1c12-4380-86a7-2df42a6f9834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08384449-1c12-4380-86a7-2df42a6f9834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0407745-fc31-4fd9-84d5-10dec1dbe056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Volume 0fb57aeb-3b49-45a5-91e1-efb7d226f239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239', 'volume_size': 1}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c768be7e-c250-496e-9bdd-39fd3afce231,created_at=2026-11-03T16:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-34150333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c768be7e-c250-496e-9bdd-39fd3afce231,host='devstack@QuobyteHD#QuobyteHD',id=0fb57aeb-3b49-45a5-91e1-efb7d226f239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5207ccda5d9468fa0837e296442c935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:26Z,use_quota=True,user_id='1360c9d77a2b4cf79e762aa5537e71f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48ec32e2-fe3d-447f-90f0-62709e7c21ff),volume_type_id=48ec32e2-fe3d-447f-90f0-62709e7c21ff)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Creating volume 0fb57aeb-3b49-45a5-91e1-efb7d226f239 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:02:26 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:26 devstack sudo[99217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 1073741824
Nov 03 17:02:26 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:26 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.510s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.manager [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:02:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Deleted volume successfully.
Nov 03 17:02:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-cfb23f0b-2cd4-484f-8a2e-18eec59094a6 req-6bdb0d70-050d-4e79-8803-6f18e9240588 tempest-TestShelveInstance-1659701464 None] Lock "cinder-966d2706-06df-4ce8-9f14-3c966ea5273e-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:27 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 1073741824" returned: 0 in 0.803s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:27 devstack sudo[99226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239
Nov 03 17:02:27 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:27 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239" returned: 0 in 0.351s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:02:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0407745-fc31-4fd9-84d5-10dec1dbe056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887f869b-3ada-4cb1-9c6d-2d26a7c1f23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:27 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Volume volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 (0fb57aeb-3b49-45a5-91e1-efb7d226f239): created successfully
Nov 03 17:02:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887f869b-3ada-4cb1-9c6d-2d26a7c1f23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Flow 'volume_create_manager' (255973df-5dd0-4ab7-91ea-9d8a65cdcdc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:02:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ab10ba2a-420d-420f-8fb4-b1b79a559972 tempest-GroupSnapshotsTest-373827168 None] Created volume successfully.
Nov 03 17:02:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] GroupSnapshot 94fa49f3-10c3-4287-88c0-3c7969637f0b: creating.
Nov 03 17:02:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] Group snapshot 94fa49f3-10c3-4287-88c0-3c7969637f0b: creating. {{(pid=87122) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 17:02:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] Creating offline snapshot 5034777b-4548-4996-9f42-a513d6d6ddd4 of volume 0fb57aeb-3b49-45a5-91e1-efb7d226f239 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:02:29 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[647c362c-7795-4765-b1d9-c9e88acff6e1]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:02:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:29 devstack sudo[99233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239
Nov 03 17:02:29 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:29 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239" returned: 0 in 0.517s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:29 devstack sudo[99249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4 1G
Nov 03 17:02:29 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:30 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4 1G" returned: 0 in 0.515s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:30 devstack sudo[99257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4
Nov 03 17:02:30 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:30 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4" returned: 0 in 0.452s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:30 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:02:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:30 devstack sudo[99263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4
Nov 03 17:02:30 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:31 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4" returned: 0 in 0.303s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:31 devstack sudo[99266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.info
Nov 03 17:02:31 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:31 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.info" returned: 0 in 0.301s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:31 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:02:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:31 devstack sudo[99269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.info
Nov 03 17:02:31 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:31 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.info" returned: 0 in 0.269s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.499s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-19261c9a-cc7f-40b3-8dd3-257f9e7d79de tempest-GroupSnapshotsTest-373827168 None] group_snapshot 94fa49f3-10c3-4287-88c0-3c7969637f0b: created successfully
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-5034777b-4548-4996-9f42-a513d6d6ddd4-ca8aa4f0-0db7-4b72-adb5-85356e4cc852" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-5034777b-4548-4996-9f42-a513d6d6ddd4-ca8aa4f0-0db7-4b72-adb5-85356e4cc852" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Creating volume ca8aa4f0-0db7-4b72-adb5-85356e4cc852 from snapshot 5034777b-4548-4996-9f42-a513d6d6ddd4 {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-ca8aa4f0-0db7-4b72-adb5-85356e4cc852" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-ca8aa4f0-0db7-4b72-adb5-85356e4cc852" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:02:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] snapshot: 5034777b-4548-4996-9f42-a513d6d6ddd4, volume: ca8aa4f0-0db7-4b72-adb5-85356e4cc852,  {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 17:02:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[68686565-9bf4-4a4f-bd70-845d7992bb51]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:02:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:34 devstack sudo[99274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4
Nov 03 17:02:34 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:35 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4" returned: 0 in 1.013s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:02:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcb76ec-85f1-444a-9b13-f14bd5f4655e]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:02:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:35 devstack sudo[99338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239
Nov 03 17:02:35 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:36 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239" returned: 0 in 0.901s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 17:02:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 17:02:36 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Path /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 17:02:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:36 devstack sudo[99350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852
Nov 03 17:02:36 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:43 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=58,cinder:INSERT=18,cinder:UPDATE=69,cinder:DELETE=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:02:43 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=68,cinder:SELECT=50,cinder:DELETE=4,cinder:INSERT=12 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:02:48 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852" returned: 0 in 12.419s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:48 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239, size 1024.00 MB, duration 12.42 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:02:48 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Converted 1024.00 MB image at 82.45 MB/s
Nov 03 17:02:48 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:02:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:48 devstack sudo[99397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852
Nov 03 17:02:48 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:48 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852" returned: 0 in 0.267s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-ca8aa4f0-0db7-4b72-adb5-85356e4cc852" released by "_copy_volume_from_snapshot" :: held 14.857s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-5034777b-4548-4996-9f42-a513d6d6ddd4-ca8aa4f0-0db7-4b72-adb5-85356e4cc852" released by "_create_volume_from_snapshot" :: held 14.984s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.022s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c32e39ad-e9b1-48ef-9330-1004d7738108 tempest-GroupSnapshotsTest-373827168 None] Create group from source-snapshot-94fa49f3-10c3-4287-88c0-3c7969637f0b completed successfully.
Nov 03 17:02:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-ca8aa4f0-0db7-4b72-adb5-85356e4cc852" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:02:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-ca8aa4f0-0db7-4b72-adb5-85356e4cc852" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:02:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d217449-f980-4638-9126-7f257c5feccb]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:02:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:49 devstack sudo[99400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852
Nov 03 17:02:49 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:50 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852" returned: 0 in 0.431s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:50 devstack sudo[99405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852
Nov 03 17:02:50 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:50 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ca8aa4f0-0db7-4b72-adb5-85356e4cc852" returned: 0 in 0.287s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-ca8aa4f0-0db7-4b72-adb5-85356e4cc852" released by "delete_volume" :: held 0.775s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:50 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Created reservations ['a6a60b8d-7ea8-4326-aab3-4565fbba9390'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:02:50 devstack cinder-volume[87122]: WARNING cinder.quota [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-640000901 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-640000901, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:02:50 devstack cinder-volume[87122]: WARNING cinder.quota [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-640000901 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-640000901, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:02:50 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Created reservations ['cc95d71b-13fb-4f22-8ca1-64534569ef94', '01d41edb-1a67-4b49-ab68-809c7e5b7dd1', '05970e97-81e0-4d3d-993b-d800c7715cd6', '842b0e49-5635-482b-ad2b-d5374953b1f9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:02:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:50 devstack sudo[99409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:02:50 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:51 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] group_snapshot 94fa49f3-10c3-4287-88c0-3c7969637f0b: deleting
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.335s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:02:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0f1dfc11-5788-489e-8778-28e6c5bc0ed8 tempest-GroupSnapshotsTest-373827168 None] Delete group completed successfully.
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] group_snapshot 94fa49f3-10c3-4287-88c0-3c7969637f0b: deleting {{(pid=87122) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-0fb57aeb-3b49-45a5-91e1-efb7d226f239" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-0fb57aeb-3b49-45a5-91e1-efb7d226f239" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-5034777b-4548-4996-9f42-a513d6d6ddd4" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-5034777b-4548-4996-9f42-a513d6d6ddd4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Deleting offline snapshot 5034777b-4548-4996-9f42-a513d6d6ddd4 of volume 0fb57aeb-3b49-45a5-91e1-efb7d226f239 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] snapshot_file for this snap is: volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d80428c-ac22-4179-99e8-c7c2f33e5487]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:51 devstack sudo[99412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4
Nov 03 17:02:51 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:51 devstack sudo[99418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:02:51 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:51 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4" returned: 0 in 0.486s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a783691b-f9fd-46e0-b05f-787039e98251]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:02:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:52 devstack sudo[99420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239
Nov 03 17:02:52 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:52 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.354s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:02:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:02:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:02:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:02:52 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239" returned: 0 in 0.643s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:52 devstack sudo[99427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4
Nov 03 17:02:52 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:53 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4" returned: 0 in 0.472s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:53 devstack sudo[99433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4
Nov 03 17:02:53 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:53 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239.5034777b-4548-4996-9f42-a513d6d6ddd4" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-5034777b-4548-4996-9f42-a513d6d6ddd4" released by "_delete_snapshot" :: held 2.013s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-0fb57aeb-3b49-45a5-91e1-efb7d226f239" released by "delete_snapshot" :: held 2.044s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:53 devstack cinder-volume[87122]: WARNING cinder.quota [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-640000901 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-640000901, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:02:53 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] Created reservations ['3029e120-708e-4139-a5a7-e90cc053a718', '4e7f54ca-6b63-488b-86c5-5e593dbcf1e3', 'cd93ba82-c76a-4eca-b6cb-b0e0a3a508b0', '5169b7f3-fbde-4424-ad80-713cf9bd39f1'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:02:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-550f6010-46df-4059-ac64-fbbc784667c8 tempest-GroupSnapshotsTest-373827168 None] group_snapshot 94fa49f3-10c3-4287-88c0-3c7969637f0b: deleted successfully
Nov 03 17:02:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-0fb57aeb-3b49-45a5-91e1-efb7d226f239" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:02:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-0fb57aeb-3b49-45a5-91e1-efb7d226f239" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:02:54 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8a52c0-7344-4ca6-94ea-42d94023894f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:02:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:54 devstack sudo[99436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239
Nov 03 17:02:54 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:54 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239" returned: 0 in 0.411s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:54 devstack sudo[99442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239
Nov 03 17:02:54 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:54 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0fb57aeb-3b49-45a5-91e1-efb7d226f239" returned: 0 in 0.313s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-0fb57aeb-3b49-45a5-91e1-efb7d226f239" released by "delete_volume" :: held 0.833s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:02:54 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Created reservations ['9d0bb9df-b7f8-49bf-8197-0f6af15a1899'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:02:54 devstack cinder-volume[87122]: WARNING cinder.db.api [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-640000901']
Nov 03 17:02:54 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Created reservations ['be095273-3732-4d77-b4f0-17866c31beab', 'bde9917b-ff72-42a4-9176-34b5e8b41878', '28548397-857b-4132-992c-bbaa3cea02e7', 'a664d0a5-3f7f-48e7-855c-4671c5275e4a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:02:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:55 devstack sudo[99445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:02:55 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:55 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.391s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:55 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:02:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4f036d7d-7894-4f04-962e-249855f53825 tempest-GroupSnapshotsTest-373827168 None] Delete group completed successfully.
Nov 03 17:02:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3954d913-17df-416d-912b-871f2533dca6 tempest-GroupSnapshotsTest-373827168 None] Group tempest-GroupSnapshotsTest-Group-2096136697: creating
Nov 03 17:02:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3954d913-17df-416d-912b-871f2533dca6 tempest-GroupSnapshotsTest-373827168 None] Group tempest-GroupSnapshotsTest-Group-2096136697: created successfully
Nov 03 17:02:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3954d913-17df-416d-912b-871f2533dca6 tempest-GroupSnapshotsTest-373827168 None] Create group completed successfully.
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Flow 'volume_create_manager' (7cd45c76-ba46-4a49-9fb9-31ac6a7c9b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4548bd2d-56eb-4409-af81-054dcc845003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4548bd2d-56eb-4409-af81-054dcc845003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-498733423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d37dd63a-35ea-4107-a900-e0fd5683c846,host='devstack@QuobyteHD#QuobyteHD',id=5ad3606c-f793-4ee7-b139-4dbb5563420d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5207ccda5d9468fa0837e296442c935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:58Z,use_quota=True,user_id='1360c9d77a2b4cf79e762aa5537e71f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e1ed9ed-6aae-461f-ac02-0fac7aa81cf6),volume_type_id=1e1ed9ed-6aae-461f-ac02-0fac7aa81cf6)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1635e95-ed82-4e68-a7e6-e608062c6145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1635e95-ed82-4e68-a7e6-e608062c6145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0d1952-a617-420c-928e-2cbd7b4c3320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0d1952-a617-420c-928e-2cbd7b4c3320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ad3606c-f793-4ee7-b139-4dbb5563420d', 'volume_name': 'volume-5ad3606c-f793-4ee7-b139-4dbb5563420d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea590644-1c4c-4094-8738-e8f3993520bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea590644-1c4c-4094-8738-e8f3993520bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4daba12d-123f-41d4-9cd2-1efa41f012e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:57 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Volume 5ad3606c-f793-4ee7-b139-4dbb5563420d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ad3606c-f793-4ee7-b139-4dbb5563420d', 'volume_size': 1}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d37dd63a-35ea-4107-a900-e0fd5683c846,created_at=2026-11-03T16:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-498733423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d37dd63a-35ea-4107-a900-e0fd5683c846,host='devstack@QuobyteHD#QuobyteHD',id=5ad3606c-f793-4ee7-b139-4dbb5563420d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5207ccda5d9468fa0837e296442c935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:58Z,use_quota=True,user_id='1360c9d77a2b4cf79e762aa5537e71f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e1ed9ed-6aae-461f-ac02-0fac7aa81cf6),volume_type_id=1e1ed9ed-6aae-461f-ac02-0fac7aa81cf6)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Creating volume 5ad3606c-f793-4ee7-b139-4dbb5563420d {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:02:57 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:02:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:57 devstack sudo[99449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d 1073741824
Nov 03 17:02:57 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:58 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d 1073741824" returned: 0 in 0.570s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:58 devstack sudo[99455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d
Nov 03 17:02:58 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:02:58 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root
Nov 03 17:02:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d" returned: 0 in 0.300s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:02:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:02:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4daba12d-123f-41d4-9cd2-1efa41f012e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad3606c-f793-4ee7-b139-4dbb5563420d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efdec3a-6230-43ce-a004-704c832c84b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Volume volume-5ad3606c-f793-4ee7-b139-4dbb5563420d (5ad3606c-f793-4ee7-b139-4dbb5563420d): created successfully
Nov 03 17:02:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efdec3a-6230-43ce-a004-704c832c84b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Flow 'volume_create_manager' (7cd45c76-ba46-4a49-9fb9-31ac6a7c9b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:02:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-05f7bc51-68b5-48b9-b139-6e04840c8ffa tempest-GroupSnapshotsTest-373827168 None] Created volume successfully.
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Flow 'volume_create_manager' (c05798a7-9a7a-4188-9e90-eeb10ea6bb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a7acb4-cc01-4012-bca0-96756e7b71b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a7acb4-cc01-4012-bca0-96756e7b71b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1597846016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d37dd63a-35ea-4107-a900-e0fd5683c846,host='devstack@QuobyteHD#QuobyteHD',id=54d5ef88-0ae1-4515-8382-e1e92f479e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5207ccda5d9468fa0837e296442c935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:00Z,use_quota=True,user_id='1360c9d77a2b4cf79e762aa5537e71f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e1ed9ed-6aae-461f-ac02-0fac7aa81cf6),volume_type_id=1e1ed9ed-6aae-461f-ac02-0fac7aa81cf6)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c941a60-821a-4d2f-bf58-87a475e6f9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c941a60-821a-4d2f-bf58-87a475e6f9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8925e8-c075-4b5b-9d3f-926248b4bef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8925e8-c075-4b5b-9d3f-926248b4bef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d5ef88-0ae1-4515-8382-e1e92f479e00', 'volume_name': 'volume-54d5ef88-0ae1-4515-8382-e1e92f479e00', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d9127a-448e-473b-9d3e-050aaab1bf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d9127a-448e-473b-9d3e-050aaab1bf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd010d7-31d4-4bba-9831-48178f6de954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:02:59 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Volume 54d5ef88-0ae1-4515-8382-e1e92f479e00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d5ef88-0ae1-4515-8382-e1e92f479e00', 'volume_size': 1}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d37dd63a-35ea-4107-a900-e0fd5683c846,created_at=2026-11-03T16:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1597846016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d37dd63a-35ea-4107-a900-e0fd5683c846,host='devstack@QuobyteHD#QuobyteHD',id=54d5ef88-0ae1-4515-8382-e1e92f479e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5207ccda5d9468fa0837e296442c935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:00Z,use_quota=True,user_id='1360c9d77a2b4cf79e762aa5537e71f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e1ed9ed-6aae-461f-ac02-0fac7aa81cf6),volume_type_id=1e1ed9ed-6aae-461f-ac02-0fac7aa81cf6)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Creating volume 54d5ef88-0ae1-4515-8382-e1e92f479e00 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:02:59 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:02:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:02:59 devstack sudo[99458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00 1073741824
Nov 03 17:02:59 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:00 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00 1073741824" returned: 0 in 0.584s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:00 devstack sudo[99465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00
Nov 03 17:03:00 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:00 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00" returned: 0 in 0.288s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:03:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:03:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd010d7-31d4-4bba-9831-48178f6de954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d5ef88-0ae1-4515-8382-e1e92f479e00', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a731ae-18e1-4991-a12b-905fea8e5554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:00 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Volume volume-54d5ef88-0ae1-4515-8382-e1e92f479e00 (54d5ef88-0ae1-4515-8382-e1e92f479e00): created successfully
Nov 03 17:03:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a731ae-18e1-4991-a12b-905fea8e5554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Flow 'volume_create_manager' (c05798a7-9a7a-4188-9e90-eeb10ea6bb1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:03:00 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7a888020-20f4-4413-b47a-87c0fd2e8748 tempest-GroupSnapshotsTest-373827168 None] Created volume successfully.
Nov 03 17:03:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f8b23f88-c85e-4d16-8ccd-c0f3ff07e44d tempest-GroupSnapshotsTest-373827168 None] Update group completed successfully.
Nov 03 17:03:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9817557a-cf45-4ff4-bfe2-50b05c148513 tempest-GroupSnapshotsTest-373827168 None] Update group completed successfully.
Nov 03 17:03:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-cbc0ddda-fc20-4fde-acd8-dea7e4d22a4e tempest-GroupSnapshotsTest-373827168 None] Update group completed successfully.
Nov 03 17:03:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-979001ae-31fc-4eb5-81fc-8ece2b8034a8 tempest-GroupSnapshotsTest-373827168 None] Update group completed successfully.
Nov 03 17:03:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-3ac50360-dd43-454c-b5bd-15379424484f req-02f29cfd-0914-4dbc-8ed1-867caf7ca5dc tempest-TestServerVolumeAttachmentScenario-1297117071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:03:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-3ac50360-dd43-454c-b5bd-15379424484f req-02f29cfd-0914-4dbc-8ed1-867caf7ca5dc tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:03:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-3ac50360-dd43-454c-b5bd-15379424484f req-02f29cfd-0914-4dbc-8ed1-867caf7ca5dc tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:03:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-3ac50360-dd43-454c-b5bd-15379424484f req-02f29cfd-0914-4dbc-8ed1-867caf7ca5dc tempest-TestServerVolumeAttachmentScenario-1297117071 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-e231d6c1-4d93-4147-b6d3-371ba3846c11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '854717ce-ec77-41e2-b4a7-3f4b58aeec2f', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:03:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-3ac50360-dd43-454c-b5bd-15379424484f req-02f29cfd-0914-4dbc-8ed1-867caf7ca5dc tempest-TestServerVolumeAttachmentScenario-1297117071 None] attachment_update completed successfully.
Nov 03 17:03:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] GroupSnapshot c76244c5-5666-4678-9e96-b0191ac64f3d: creating.
Nov 03 17:03:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Group snapshot c76244c5-5666-4678-9e96-b0191ac64f3d: creating. {{(pid=87122) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 17:03:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:03:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:03:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Creating offline snapshot e8d55781-25f1-4507-b217-398f967774ac of volume 54d5ef88-0ae1-4515-8382-e1e92f479e00 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:03:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e931dea-410c-46bd-adf3-bb290dab9acc]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:08 devstack sudo[99583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00
Nov 03 17:03:08 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:08 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00" returned: 0 in 0.504s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:08 devstack sudo[99904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac 1G
Nov 03 17:03:08 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:09 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac 1G" returned: 0 in 0.543s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54d5ef88-0ae1-4515-8382-e1e92f479e00 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:09 devstack sudo[99910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54d5ef88-0ae1-4515-8382-e1e92f479e00 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac
Nov 03 17:03:09 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:09 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54d5ef88-0ae1-4515-8382-e1e92f479e00 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac" returned: 0 in 0.400s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:09 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:03:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:09 devstack sudo[99920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac
Nov 03 17:03:09 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:09 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac" returned: 0 in 0.308s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:09 devstack sudo[99924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.info
Nov 03 17:03:09 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:10 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.info" returned: 0 in 0.425s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:10 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:03:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:10 devstack sudo[99927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.info
Nov 03 17:03:10 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:10 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.info" returned: 0 in 0.327s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.631s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:03:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:03:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:03:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Creating offline snapshot ebf45bce-009c-42f2-be57-0cd280652eec of volume 5ad3606c-f793-4ee7-b139-4dbb5563420d {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:03:10 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[74490a45-4cbe-4e43-b34b-984a603a7068]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:10 devstack sudo[99931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d
Nov 03 17:03:10 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:11 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d" returned: 0 in 0.560s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:11 devstack sudo[99936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec 1G
Nov 03 17:03:11 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:12 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec 1G" returned: 0 in 0.751s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad3606c-f793-4ee7-b139-4dbb5563420d -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:12 devstack sudo[99941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad3606c-f793-4ee7-b139-4dbb5563420d -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec
Nov 03 17:03:12 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:12 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad3606c-f793-4ee7-b139-4dbb5563420d -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec" returned: 0 in 0.392s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:12 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:03:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:12 devstack sudo[99949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec
Nov 03 17:03:12 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:12 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:12 devstack sudo[99986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.info
Nov 03 17:03:12 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-ac49606a-8b5f-45b3-9ce2-f0e01e907b9a req-f565bbac-5af4-42b2-8fb3-4e885b08a511 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:03:13 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.info" returned: 0 in 0.419s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:13 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:03:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:13 devstack sudo[100000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.info
Nov 03 17:03:13 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:13 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.info" returned: 0 in 0.320s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:03:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-ac49606a-8b5f-45b3-9ce2-f0e01e907b9a req-f565bbac-5af4-42b2-8fb3-4e885b08a511 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.410s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:03:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-ac49606a-8b5f-45b3-9ce2-f0e01e907b9a req-f565bbac-5af4-42b2-8fb3-4e885b08a511 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:03:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-ac49606a-8b5f-45b3-9ce2-f0e01e907b9a req-f565bbac-5af4-42b2-8fb3-4e885b08a511 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-6192a520-613c-45db-80c5-047b483bb61f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4cedc075-4f0e-4a17-9584-4aaffdfc1eb3', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:03:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6aeb18d3-c849-4fe0-b2fe-34c0d89e5fb2 tempest-GroupSnapshotsTest-373827168 None] group_snapshot c76244c5-5666-4678-9e96-b0191ac64f3d: created successfully
Nov 03 17:03:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-ac49606a-8b5f-45b3-9ce2-f0e01e907b9a req-f565bbac-5af4-42b2-8fb3-4e885b08a511 tempest-TestServerVolumeAttachmentScenario-1297117071 None] attachment_update completed successfully.
Nov 03 17:03:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] group_snapshot c76244c5-5666-4678-9e96-b0191ac64f3d: deleting
Nov 03 17:03:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] group_snapshot c76244c5-5666-4678-9e96-b0191ac64f3d: deleting {{(pid=87122) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 17:03:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-54d5ef88-0ae1-4515-8382-e1e92f479e00" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:03:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-54d5ef88-0ae1-4515-8382-e1e92f479e00" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:03:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-e8d55781-25f1-4507-b217-398f967774ac" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:03:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-e8d55781-25f1-4507-b217-398f967774ac" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:03:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Deleting offline snapshot e8d55781-25f1-4507-b217-398f967774ac of volume 54d5ef88-0ae1-4515-8382-e1e92f479e00 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:03:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] snapshot_file for this snap is: volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:03:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c955dd8-965d-4ba9-8672-9c8c5de8fd23]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:15 devstack sudo[100005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac
Nov 03 17:03:15 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:15 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac" returned: 0 in 0.598s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54d5ef88-0ae1-4515-8382-e1e92f479e00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:03:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e9c3e7-5ff3-4065-b321-35f28a504781]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:15 devstack sudo[100010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00
Nov 03 17:03:15 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:16 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00" returned: 0 in 0.616s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:16 devstack sudo[100017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac
Nov 03 17:03:16 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-2906ba89-0033-444c-bcef-edbce3d457b2 req-43251ee4-3cb8-4696-b82c-55bc858e99d4 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Terminate volume connection completed successfully.
Nov 03 17:03:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-2906ba89-0033-444c-bcef-edbce3d457b2 req-43251ee4-3cb8-4696-b82c-55bc858e99d4 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Deleting attachment 4cedc075-4f0e-4a17-9584-4aaffdfc1eb3. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:03:16 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac" returned: 0 in 0.559s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:16 devstack sudo[100024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac
Nov 03 17:03:16 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:17 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00.e8d55781-25f1-4507-b217-398f967774ac" returned: 0 in 0.481s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-e8d55781-25f1-4507-b217-398f967774ac" released by "_delete_snapshot" :: held 2.457s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:03:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-54d5ef88-0ae1-4515-8382-e1e92f479e00" released by "delete_snapshot" :: held 2.494s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:03:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-5ad3606c-f793-4ee7-b139-4dbb5563420d" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:03:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-5ad3606c-f793-4ee7-b139-4dbb5563420d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:03:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-ebf45bce-009c-42f2-be57-0cd280652eec" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:03:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-ebf45bce-009c-42f2-be57-0cd280652eec" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:03:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Deleting offline snapshot ebf45bce-009c-42f2-be57-0cd280652eec of volume 5ad3606c-f793-4ee7-b139-4dbb5563420d {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:03:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] snapshot_file for this snap is: volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:03:17 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ababb86-1ef3-4183-9366-8417309e3d58]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:17 devstack sudo[100027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec
Nov 03 17:03:17 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:18 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec" returned: 0 in 0.589s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ad3606c-f793-4ee7-b139-4dbb5563420d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:03:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8057e8-26fb-40be-8e9a-49865d369902]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:18 devstack sudo[100033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d
Nov 03 17:03:18 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-9f6ec5eb-e440-45af-a587-03ddd33c6746 req-84a492f7-3a7f-4a3f-a279-ebb27f9e624d tempest-TestServerVolumeAttachmentScenario-1297117071 None] Terminate volume connection completed successfully.
Nov 03 17:03:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-9f6ec5eb-e440-45af-a587-03ddd33c6746 req-84a492f7-3a7f-4a3f-a279-ebb27f9e624d tempest-TestServerVolumeAttachmentScenario-1297117071 None] Deleting attachment 854717ce-ec77-41e2-b4a7-3f4b58aeec2f. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:03:18 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d" returned: 0 in 0.543s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:18 devstack sudo[100065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec
Nov 03 17:03:18 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:19 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec" returned: 0 in 0.507s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:19 devstack sudo[100071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec
Nov 03 17:03:19 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:19 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d.ebf45bce-009c-42f2-be57-0cd280652eec" returned: 0 in 0.320s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-ebf45bce-009c-42f2-be57-0cd280652eec" released by "_delete_snapshot" :: held 2.149s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:03:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-5ad3606c-f793-4ee7-b139-4dbb5563420d" released by "delete_snapshot" :: held 2.181s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:03:19 devstack cinder-volume[87122]: WARNING cinder.quota [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-430759221 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-430759221, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:03:19 devstack cinder-volume[87122]: WARNING cinder.quota [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-430759221 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-430759221, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:03:19 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Created reservations ['44fb10bc-5b51-4aae-a46f-b499db5d0238', '3955d7f7-c56f-4bfc-8db5-662220fd4219', '568376eb-89ee-4753-84d3-cc6490bcabb6', 'b6b5c430-2d26-4fa9-8064-9ab6cadbd0a8'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:03:19 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] Created reservations ['34e33844-fe54-479a-963a-782f95f8e332', '826c055d-557d-478d-9148-a793021e441c', '5e1f98c4-3ca1-4d7c-876f-e1493723ba82', '868de558-4f4b-4212-9bb8-1ea1e0a586d6'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:03:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e0573868-ad3f-4613-aa84-a615a7832951 tempest-GroupSnapshotsTest-373827168 None] group_snapshot c76244c5-5666-4678-9e96-b0191ac64f3d: deleted successfully
Nov 03 17:03:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-54d5ef88-0ae1-4515-8382-e1e92f479e00" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:03:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-54d5ef88-0ae1-4515-8382-e1e92f479e00" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:03:21 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f7239e-82a8-42db-82cb-69f14f4b27e6]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:21 devstack sudo[100096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00
Nov 03 17:03:21 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:21 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00" returned: 0 in 0.510s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:21 devstack sudo[100101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00
Nov 03 17:03:21 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:22 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54d5ef88-0ae1-4515-8382-e1e92f479e00" returned: 0 in 0.377s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-54d5ef88-0ae1-4515-8382-e1e92f479e00" released by "delete_volume" :: held 1.000s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:03:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-5ad3606c-f793-4ee7-b139-4dbb5563420d" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:03:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-5ad3606c-f793-4ee7-b139-4dbb5563420d" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:03:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d01ca42-61d1-4155-88a1-2049c6638800]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:22 devstack sudo[100106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d
Nov 03 17:03:22 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:22 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d" returned: 0 in 0.601s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:22 devstack sudo[100114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d
Nov 03 17:03:22 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:23 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ad3606c-f793-4ee7-b139-4dbb5563420d" returned: 0 in 0.496s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-5ad3606c-f793-4ee7-b139-4dbb5563420d" released by "delete_volume" :: held 1.210s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Flow 'volume_create_manager' (ec9fd14b-0151-487f-b8ac-48e86c01d752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7b6ffa-ac54-408e-a934-e9645ad5a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7b6ffa-ac54-408e-a934-e9645ad5a50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-794184734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f693ebfa-e74b-40e8-9664-1a214f73d171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ecae265c6394b07b5504a2a55a954a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:23Z,use_quota=True,user_id='17b77491ef79434e9f6bd4bcc336e149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b2fff6-0a14-4e9a-9592-0bd7402eef74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b2fff6-0a14-4e9a-9592-0bd7402eef74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e59c09-10d3-4dd7-bbd3-c89f5c1469ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e59c09-10d3-4dd7-bbd3-c89f5c1469ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f693ebfa-e74b-40e8-9664-1a214f73d171', 'volume_name': 'volume-f693ebfa-e74b-40e8-9664-1a214f73d171', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf166799-5c8d-4fc4-9871-0950960b1881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf166799-5c8d-4fc4-9871-0950960b1881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91969144-3ccc-499f-b4c5-0763100320d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Volume f693ebfa-e74b-40e8-9664-1a214f73d171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f693ebfa-e74b-40e8-9664-1a214f73d171', 'volume_size': 1}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-794184734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f693ebfa-e74b-40e8-9664-1a214f73d171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ecae265c6394b07b5504a2a55a954a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:23Z,use_quota=True,user_id='17b77491ef79434e9f6bd4bcc336e149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Creating volume f693ebfa-e74b-40e8-9664-1a214f73d171 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:03:23 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:23 devstack sudo[100119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171 1073741824
Nov 03 17:03:23 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Created reservations ['e8700822-cfec-49b5-917a-ffc2620b594d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:03:23 devstack cinder-volume[87122]: WARNING cinder.quota [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-430759221 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-430759221, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:03:23 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Created reservations ['7793fada-b528-4cc8-a02a-13a7b988c22d', '7c0bc1be-20e4-4ef0-93be-edc9c721f94c', '17d93ab2-6db2-41ba-aa6c-f7f52950a622', '6ed17380-d416-42ec-a4c9-452b4849d10a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Created reservations ['aee2708c-009e-4f54-99fb-9b60bf7b3bba', '710c3b8b-773c-4e33-bf42-e70382192eb7', 'dba72557-8664-479b-8a38-e9db8114749c', 'b63d91ad-2b07-4e3d-914d-7a2ec6ebb05b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:24 devstack sudo[100125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:03:24 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:24 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171 1073741824" returned: 0 in 0.724s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:24 devstack sudo[100127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171
Nov 03 17:03:24 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:24 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.344s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:03:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-76d2c0b5-fa7c-4bca-814e-59bc21424988 tempest-GroupSnapshotsTest-373827168 None] Delete group completed successfully.
Nov 03 17:03:24 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171" returned: 0 in 0.327s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91969144-3ccc-499f-b4c5-0763100320d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f693ebfa-e74b-40e8-9664-1a214f73d171', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7551323-8cae-452b-9917-a8a7c9646290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:24 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Volume volume-f693ebfa-e74b-40e8-9664-1a214f73d171 (f693ebfa-e74b-40e8-9664-1a214f73d171): created successfully
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7551323-8cae-452b-9917-a8a7c9646290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Flow 'volume_create_manager' (ec9fd14b-0151-487f-b8ac-48e86c01d752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:03:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e580ab05-c5cf-4f50-bf38-46fccb9ffd88 tempest-TestImageHashVerification-529748350 None] Created volume successfully.
Nov 03 17:03:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c10cb521-f1c5-4f20-bad9-e64701c2fa80 tempest-GroupSnapshotsTest-373827168 None] Group tempest-GroupSnapshotsTest-Group-21554303: creating
Nov 03 17:03:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c10cb521-f1c5-4f20-bad9-e64701c2fa80 tempest-GroupSnapshotsTest-373827168 None] Group tempest-GroupSnapshotsTest-Group-21554303: created successfully
Nov 03 17:03:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c10cb521-f1c5-4f20-bad9-e64701c2fa80 tempest-GroupSnapshotsTest-373827168 None] Create group completed successfully.
Nov 03 17:03:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Acquiring lock "cinder-6192a520-613c-45db-80c5-047b483bb61f-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:03:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "cinder-6192a520-613c-45db-80c5-047b483bb61f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:03:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Acquiring lock "cinder-quobyte-6192a520-613c-45db-80c5-047b483bb61f" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:03:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "cinder-quobyte-6192a520-613c-45db-80c5-047b483bb61f" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:03:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[654ea876-4ffc-42e7-b153-16a80dbfb1fe]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6192a520-613c-45db-80c5-047b483bb61f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:26 devstack sudo[100149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6192a520-613c-45db-80c5-047b483bb61f
Nov 03 17:03:26 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:03:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:03:26 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3796afec-e998-4f8a-8030-a080b4a3f13a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6192a520-613c-45db-80c5-047b483bb61f" returned: 0 in 0.477s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6192a520-613c-45db-80c5-047b483bb61f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:26 devstack sudo[100155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6192a520-613c-45db-80c5-047b483bb61f
Nov 03 17:03:26 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:26 devstack sudo[100154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171
Nov 03 17:03:26 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:27 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6192a520-613c-45db-80c5-047b483bb61f" returned: 0 in 0.299s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "cinder-quobyte-6192a520-613c-45db-80c5-047b483bb61f" released by "delete_volume" :: held 0.840s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Created reservations ['df0961d6-771e-4ef9-9114-856403671284', 'b172ae8f-f11a-4774-9a72-6e5871045d67', '7a17d778-f29e-4f75-ab38-e5a617028c22', '4fb9bb2a-ab95-4500-bea0-13c9dc8dd7f7'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:03:27 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171" returned: 0 in 0.527s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9894d2-60b4-42da-bd3b-a5cf68bef3c3]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Acquiring lock "cinder-e231d6c1-4d93-4147-b6d3-371ba3846c11-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:27 devstack sudo[100162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171
Nov 03 17:03:27 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:27 devstack sudo[100163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:03:27 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "cinder-e231d6c1-4d93-4147-b6d3-371ba3846c11-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Acquiring lock "cinder-quobyte-e231d6c1-4d93-4147-b6d3-371ba3846c11" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "cinder-quobyte-e231d6c1-4d93-4147-b6d3-371ba3846c11" acquired by "delete_volume" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b06c61-5834-4749-a126-49af5bfbea6c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e231d6c1-4d93-4147-b6d3-371ba3846c11 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:27 devstack sudo[100166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e231d6c1-4d93-4147-b6d3-371ba3846c11
Nov 03 17:03:27 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:28 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:28 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.622s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:03:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Deleted volume successfully.
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171" returned: 0 in 0.752s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171 /opt/stack/data/cinder/conversion/f693ebfa-e74b-40e8-9664-1a214f73d171.temp_image.3c3279a9-eb28-40f0-a796-452c24ba6177iph_g7ii.img {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:03:28 devstack sudo[100173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171 /opt/stack/data/cinder/conversion/f693ebfa-e74b-40e8-9664-1a214f73d171.temp_image.3c3279a9-eb28-40f0-a796-452c24ba6177iph_g7ii.img
Nov 03 17:03:28 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Flow 'volume_create_manager' (53c1e5eb-94bc-446e-9e52-0c4a2550fabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7ce7de-4f66-4e99-9501-4570a514ab1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0149148a-8791-4575-8ca6-29ccb7376050 tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "cinder-6192a520-613c-45db-80c5-047b483bb61f-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7ce7de-4f66-4e99-9501-4570a514ab1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1861173249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d880b5b0-62c8-4f79-a3cb-ce30d4f6c5ce,host='devstack@QuobyteHD#QuobyteHD',id=bc54f517-5eb2-42f9-a3f5-13db2b1db770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5207ccda5d9468fa0837e296442c935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:28Z,use_quota=True,user_id='1360c9d77a2b4cf79e762aa5537e71f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2945625-29a1-4042-ae9e-6583c3aa6f98),volume_type_id=b2945625-29a1-4042-ae9e-6583c3aa6f98)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbab278b-14a4-4431-92ca-7c61c67d96c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbab278b-14a4-4431-92ca-7c61c67d96c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6934634-4f09-4308-b3d1-95effece1edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6934634-4f09-4308-b3d1-95effece1edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc54f517-5eb2-42f9-a3f5-13db2b1db770', 'volume_name': 'volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83851b37-e9b0-4ba2-8a5a-44f8d90198ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83851b37-e9b0-4ba2-8a5a-44f8d90198ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567b331a-864e-4aaa-acdd-86fd788cfd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:28 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Volume bc54f517-5eb2-42f9-a3f5-13db2b1db770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770', 'volume_size': 1}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:03:28 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e231d6c1-4d93-4147-b6d3-371ba3846c11" returned: 0 in 0.648s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e231d6c1-4d93-4147-b6d3-371ba3846c11 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:28 devstack sudo[100178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e231d6c1-4d93-4147-b6d3-371ba3846c11
Nov 03 17:03:28 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:28 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e231d6c1-4d93-4147-b6d3-371ba3846c11" returned: 0 in 0.325s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "cinder-quobyte-e231d6c1-4d93-4147-b6d3-371ba3846c11" released by "delete_volume" :: held 1.085s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Created reservations ['3af6300b-44e1-4aa5-8453-bfd01b59cc5a', '57fb3ec8-d2ac-4148-a3cf-7c2435f12a67', '6eae6c0c-da27-4b22-9189-3abea5a3a63c', 'dcf21b4b-f9af-425e-b947-3915648005df'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:03:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:29 devstack sudo[100194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:03:29 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:29 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.870s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:29 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:03:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Deleted volume successfully.
Nov 03 17:03:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9eb3b98b-768f-4ca9-a54a-b35266e31b0a tempest-TestServerVolumeAttachmentScenario-1297117071 None] Lock "cinder-e231d6c1-4d93-4147-b6d3-371ba3846c11-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:03:35 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:03:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Flow 'volume_create_manager' (4eaee638-7d24-4419-85b1-f5f47fcb34e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:03:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaccf008-427b-42f3-9a56-b05e700ede4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaccf008-427b-42f3-9a56-b05e700ede4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1751370469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1d55d7-7488-4a22-aa8f-ac05cd602234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbeea83e1424854bef08a7f36229c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:35Z,use_quota=True,user_id='f3e4fe41fce64c9cbeb33f3999bd873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562e116a-f973-42f3-bb9a-66434417076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562e116a-f973-42f3-bb9a-66434417076e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee7199a-48a0-46fd-8394-c0faca9a4cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee7199a-48a0-46fd-8394-c0faca9a4cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da1d55d7-7488-4a22-aa8f-ac05cd602234', 'volume_name': 'volume-da1d55d7-7488-4a22-aa8f-ac05cd602234', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d80813a-cccf-4b4b-a09f-853f39209062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d80813a-cccf-4b4b-a09f-853f39209062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390bc706-ce2c-460f-919a-97dabeed73f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:35 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Volume da1d55d7-7488-4a22-aa8f-ac05cd602234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da1d55d7-7488-4a22-aa8f-ac05cd602234', 'volume_size': 1}
Nov 03 17:03:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:03:38 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171 /opt/stack/data/cinder/conversion/f693ebfa-e74b-40e8-9664-1a214f73d171.temp_image.3c3279a9-eb28-40f0-a796-452c24ba6177iph_g7ii.img" returned: 0 in 10.137s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeeaea4a-ace4-4abf-89e6-f61035cbf059]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:38 devstack sudo[100267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171
Nov 03 17:03:38 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:39 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171" returned: 0 in 0.757s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:39 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171, size 1024.00 MB, duration 10.14 sec, destination /opt/stack/data/cinder/conversion/f693ebfa-e74b-40e8-9664-1a214f73d171.temp_image.3c3279a9-eb28-40f0-a796-452c24ba6177iph_g7ii.img {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:03:39 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] Converted 1024.00 MB image at 101.01 MB/s
Nov 03 17:03:39 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] 3c3279a9-eb28-40f0-a796-452c24ba6177 was raw, no need to convert to raw {{(pid=87122) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 03 17:03:45 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=108,cinder:INSERT=19,cinder:SELECT=100,cinder:DELETE=2 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:03:49 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=110,cinder:UPDATE=90,cinder:INSERT=26,cinder:DELETE=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:03:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:03:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:03:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:03:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:03:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:03:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:03:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:51 devstack sudo[100296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:03:51 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:52 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.321s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:03:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:03:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:03:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Flow 'volume_create_manager' (96844bf3-bcb7-4c2c-b0cb-58747c6c80f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4ca171-d5ea-4bfd-8ef7-df947e81ff1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4ca171-d5ea-4bfd-8ef7-df947e81ff1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8649c45-2136-40a0-9d82-aeb3a7cfa745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='933c16c4515b44068f2dfd88280d6ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:54Z,use_quota=True,user_id='ccf57d1fa165452aafee4d17cdf9ee09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(806ca8a2-4caf-4a20-aa54-be5b32295294),volume_type_id=806ca8a2-4caf-4a20-aa54-be5b32295294)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21a74f5-8c05-434b-a295-afa3c10baef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21a74f5-8c05-434b-a295-afa3c10baef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d728a73-8196-4766-ad90-743d7f0678fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d728a73-8196-4766-ad90-743d7f0678fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8649c45-2136-40a0-9d82-aeb3a7cfa745', 'volume_name': 'volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745', 'volume_size': 1, 'image_id': 'b586b990-9018-4e99-99be-107f66c9c06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b586b990-9018-4e99-99be-107f66c9c06e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c84e1990cb462d2ea0785259c8b2e65', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '933c16c4515b44068f2dfd88280d6ce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9eabe09d3491e215cbded526ad9103a5f1b08420c8ba038d6021ac36eb9e61d024e8a737621924e12aefa058bc838543cc3861aeedbbdabb299fc59abdbd758', 'id': 'b586b990-9018-4e99-99be-107f66c9c06e', 'created_at': datetime.datetime(2026, 11, 3, 16, 3, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 3, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b586b990-9018-4e99-99be-107f66c9c06e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e723ab14050>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0f8f4e-ebf0-4f08-8c1d-d7d44ddcdb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0f8f4e-ebf0-4f08-8c1d-d7d44ddcdb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906ae054-0be4-489b-88b4-763c718cb42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:03:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Volume b8649c45-2136-40a0-9d82-aeb3a7cfa745: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745', 'volume_size': 1, 'image_id': 'b586b990-9018-4e99-99be-107f66c9c06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b586b990-9018-4e99-99be-107f66c9c06e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c84e1990cb462d2ea0785259c8b2e65', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '933c16c4515b44068f2dfd88280d6ce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9eabe09d3491e215cbded526ad9103a5f1b08420c8ba038d6021ac36eb9e61d024e8a737621924e12aefa058bc838543cc3861aeedbbdabb299fc59abdbd758', 'id': 'b586b990-9018-4e99-99be-107f66c9c06e', 'created_at': datetime.datetime(2026, 11, 3, 16, 3, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 3, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b586b990-9018-4e99-99be-107f66c9c06e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e723ab14050>}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Trying to clone b8649c45-2136-40a0-9d82-aeb3a7cfa745 from image b586b990-9018-4e99-99be-107f66c9c06e at location (None, [{'url': 'file:///opt/stack/data/glance/images/b586b990-9018-4e99-99be-107f66c9c06e', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 17:03:54 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f60521-6ad1-490b-96be-180861844bfa]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:54 devstack sudo[100299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD
Nov 03 17:03:54 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:54 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:55 devstack sudo[100303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD
Nov 03 17:03:55 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:55 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:03:55 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Temporary image b586b990-9018-4e99-99be-107f66c9c06e is fetched for user ccf57d1fa165452aafee4d17cdf9ee09. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 17:03:55 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[63430f56-530c-4ecc-aada-c8e5b41b3dd6]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:03:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:55 devstack sudo[100308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD
Nov 03 17:03:55 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:55 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:03:55 devstack sudo[100312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD
Nov 03 17:03:55 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:03:56 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root
Nov 03 17:03:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:03:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:03:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.183s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] Uploaded volume to glance image-id: 3c3279a9-eb28-40f0-a796-452c24ba6177. {{(pid=87122) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 03 17:04:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.693s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d880b5b0-62c8-4f79-a3cb-ce30d4f6c5ce,created_at=2026-11-03T16:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1861173249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d880b5b0-62c8-4f79-a3cb-ce30d4f6c5ce,host='devstack@QuobyteHD#QuobyteHD',id=bc54f517-5eb2-42f9-a3f5-13db2b1db770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5207ccda5d9468fa0837e296442c935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:28Z,use_quota=True,user_id='1360c9d77a2b4cf79e762aa5537e71f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2945625-29a1-4042-ae9e-6583c3aa6f98),volume_type_id=b2945625-29a1-4042-ae9e-6583c3aa6f98)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Creating volume bc54f517-5eb2-42f9-a3f5-13db2b1db770 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:00 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-615605cc-8ee6-434c-8718-2333b206e5e9 tempest-TestImageHashVerification-529748350 None] Copy volume to image completed successfully.
Nov 03 17:04:01 devstack sudo[100318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770 1073741824
Nov 03 17:04:01 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:01 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770 1073741824" returned: 0 in 0.521s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:01 devstack sudo[100324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770
Nov 03 17:04:01 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:01 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770" returned: 0 in 0.302s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.474s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1751370469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1d55d7-7488-4a22-aa8f-ac05cd602234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbeea83e1424854bef08a7f36229c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:35Z,use_quota=True,user_id='f3e4fe41fce64c9cbeb33f3999bd873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Creating volume da1d55d7-7488-4a22-aa8f-ac05cd602234 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:01 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-da1d55d7-7488-4a22-aa8f-ac05cd602234 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567b331a-864e-4aaa-acdd-86fd788cfd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:01 devstack sudo[100327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-da1d55d7-7488-4a22-aa8f-ac05cd602234 1073741824
Nov 03 17:04:01 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635d035a-9a7c-4ba5-8ff5-70edccefea33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:01 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Volume volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770 (bc54f517-5eb2-42f9-a3f5-13db2b1db770): created successfully
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635d035a-9a7c-4ba5-8ff5-70edccefea33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Flow 'volume_create_manager' (53c1e5eb-94bc-446e-9e52-0c4a2550fabe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Acquiring lock "cinder-f693ebfa-e74b-40e8-9664-1a214f73d171-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a03361cc-335a-4092-af72-d924f225f0b1 tempest-GroupSnapshotsTest-373827168 None] Created volume successfully.
Nov 03 17:04:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Lock "cinder-f693ebfa-e74b-40e8-9664-1a214f73d171-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Acquiring lock "cinder-quobyte-f693ebfa-e74b-40e8-9664-1a214f73d171" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Lock "cinder-quobyte-f693ebfa-e74b-40e8-9664-1a214f73d171" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f023da-b20e-41a7-ae32-ebae2186dc6a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:02 devstack sudo[100329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171
Nov 03 17:04:02 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:02 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-da1d55d7-7488-4a22-aa8f-ac05cd602234 1073741824" returned: 0 in 0.515s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-da1d55d7-7488-4a22-aa8f-ac05cd602234 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:02 devstack sudo[100334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-da1d55d7-7488-4a22-aa8f-ac05cd602234
Nov 03 17:04:02 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:02 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171" returned: 0 in 0.457s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:02 devstack sudo[100339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171
Nov 03 17:04:02 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:02 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-da1d55d7-7488-4a22-aa8f-ac05cd602234" returned: 0 in 0.294s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.694s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8649c45-2136-40a0-9d82-aeb3a7cfa745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='933c16c4515b44068f2dfd88280d6ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:54Z,use_quota=True,user_id='ccf57d1fa165452aafee4d17cdf9ee09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(806ca8a2-4caf-4a20-aa54-be5b32295294),volume_type_id=806ca8a2-4caf-4a20-aa54-be5b32295294)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Creating volume b8649c45-2136-40a0-9d82-aeb3a7cfa745 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:02 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:02 devstack sudo[100342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745 1073741824
Nov 03 17:04:02 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390bc706-ce2c-460f-919a-97dabeed73f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da1d55d7-7488-4a22-aa8f-ac05cd602234', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5788cb-fbbd-4be4-8da7-2c266b2a2628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:02 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Volume volume-da1d55d7-7488-4a22-aa8f-ac05cd602234 (da1d55d7-7488-4a22-aa8f-ac05cd602234): created successfully
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5788cb-fbbd-4be4-8da7-2c266b2a2628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Flow 'volume_create_manager' (4eaee638-7d24-4419-85b1-f5f47fcb34e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:02 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f693ebfa-e74b-40e8-9664-1a214f73d171" returned: 0 in 0.311s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fcd95de5-c93b-4893-a033-2159321c9c38 tempest-VolumesActionsTest-336551269 None] Created volume successfully.
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Lock "cinder-quobyte-f693ebfa-e74b-40e8-9664-1a214f73d171" released by "delete_volume" :: held 0.835s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] GroupSnapshot 6c4d12fd-a922-40e4-aaa1-2fa87d9d6781: creating.
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] Group snapshot 6c4d12fd-a922-40e4-aaa1-2fa87d9d6781: creating. {{(pid=87122) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Created reservations ['b39c0580-8cb6-4888-abb7-c395530a8e1b', '718dfb04-064c-4664-8168-9c209e0d3a8b', '8f9eef68-3b2f-472c-991e-03d4d08ecb0c', '56686a59-bab7-49e8-a900-03714f10ed01'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:03 devstack sudo[100348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:03 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:03 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745 1073741824" returned: 0 in 0.561s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:03 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Deleted volume successfully.
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:03 devstack sudo[100351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745
Nov 03 17:04:03 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cf0c6f0-e683-4320-bcc6-66843ac03ac3 tempest-TestImageHashVerification-529748350 None] Lock "cinder-f693ebfa-e74b-40e8-9664-1a214f73d171-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c5be292b-6fda-4763-904b-062383edb3e5 tempest-VolumesActionsTest-336551269 None] Acquiring lock "cinder-da1d55d7-7488-4a22-aa8f-ac05cd602234" by "attach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c5be292b-6fda-4763-904b-062383edb3e5 tempest-VolumesActionsTest-336551269 None] Lock "cinder-da1d55d7-7488-4a22-aa8f-ac05cd602234" acquired by "attach_volume" :: waited 0.044s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:03 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745" returned: 0 in 0.326s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.699s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] Creating offline snapshot db32b762-4eb9-4992-82ea-5bf8747ef277 of volume bc54f517-5eb2-42f9-a3f5-13db2b1db770 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfffee49-767c-46b6-8481-feeea505c996]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Attempting download of b586b990-9018-4e99-99be-107f66c9c06e ((None, [{'url': 'file:///opt/stack/data/glance/images/b586b990-9018-4e99-99be-107f66c9c06e', 'metadata': {}}])) to volume b8649c45-2136-40a0-9d82-aeb3a7cfa745. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 17:04:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c5be292b-6fda-4763-904b-062383edb3e5 tempest-VolumesActionsTest-336551269 None] Attaching volume da1d55d7-7488-4a22-aa8f-ac05cd602234 to instance 4351ba2f-7a2a-4b2a-8dfc-52ffa416610c at mountpoint /dev/vdb on host None.
Nov 03 17:04:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c5be292b-6fda-4763-904b-062383edb3e5 tempest-VolumesActionsTest-336551269 None] Attach volume completed successfully.
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c5be292b-6fda-4763-904b-062383edb3e5 tempest-VolumesActionsTest-336551269 None] Lock "cinder-da1d55d7-7488-4a22-aa8f-ac05cd602234" released by "attach_volume" :: held 0.213s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[95028c1f-974e-4957-b953-c6212ce1b103]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b586b990-9018-4e99-99be-107f66c9c06e_ozky7iwp {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:03 devstack sudo[100354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770
Nov 03 17:04:03 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:03 devstack sudo[100355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b586b990-9018-4e99-99be-107f66c9c06e_ozky7iwp
Nov 03 17:04:03 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:04 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:04 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770" returned: 0 in 0.594s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b586b990-9018-4e99-99be-107f66c9c06e_ozky7iwp" returned: 0 in 0.509s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b586b990-9018-4e99-99be-107f66c9c06e_ozky7iwp {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:04 devstack sudo[100364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277 1G
Nov 03 17:04:04 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:04 devstack sudo[100365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b586b990-9018-4e99-99be-107f66c9c06e_ozky7iwp
Nov 03 17:04:04 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:04 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b586b990-9018-4e99-99be-107f66c9c06e_ozky7iwp" returned: 1 in 0.435s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b586b990-9018-4e99-99be-107f66c9c06e_ozky7iwp' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:04:04 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a852ab4-136b-4bd9-ae65-d444b525f5d2]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1398cb1d-b5a5-4338-be5c-0e458f020795 tempest-VolumesActionsTest-1164560133 None] Terminate volume connection completed successfully.
Nov 03 17:04:04 devstack sudo[100373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD
Nov 03 17:04:04 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1398cb1d-b5a5-4338-be5c-0e458f020795 tempest-VolumesActionsTest-1164560133 None] Acquiring lock "cinder-da1d55d7-7488-4a22-aa8f-ac05cd602234-detach_volume" by "detach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1398cb1d-b5a5-4338-be5c-0e458f020795 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-da1d55d7-7488-4a22-aa8f-ac05cd602234-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1398cb1d-b5a5-4338-be5c-0e458f020795 tempest-VolumesActionsTest-1164560133 None] Detaching volume da1d55d7-7488-4a22-aa8f-ac05cd602234 from instance 4351ba2f-7a2a-4b2a-8dfc-52ffa416610c.
Nov 03 17:04:04 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277 1G" returned: 0 in 0.669s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:05 devstack sudo[100376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277
Nov 03 17:04:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1398cb1d-b5a5-4338-be5c-0e458f020795 tempest-VolumesActionsTest-1164560133 None] Detach volume completed successfully.
Nov 03 17:04:05 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1398cb1d-b5a5-4338-be5c-0e458f020795 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-da1d55d7-7488-4a22-aa8f-ac05cd602234-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:05 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-314c94c5-b348-4ae4-9162-44f48108d3f1 tempest-VolumesActionsTest-336551269 None] Acquiring lock "cinder-da1d55d7-7488-4a22-aa8f-ac05cd602234-detach_volume" by "detach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-314c94c5-b348-4ae4-9162-44f48108d3f1 tempest-VolumesActionsTest-336551269 None] Lock "cinder-da1d55d7-7488-4a22-aa8f-ac05cd602234-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-314c94c5-b348-4ae4-9162-44f48108d3f1 tempest-VolumesActionsTest-336551269 None] Volume detach called, but volume not attached.
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-314c94c5-b348-4ae4-9162-44f48108d3f1 tempest-VolumesActionsTest-336551269 None] Lock "cinder-da1d55d7-7488-4a22-aa8f-ac05cd602234-detach_volume" released by "detach_volume" :: held 0.021s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:05 devstack sudo[100381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD
Nov 03 17:04:05 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:05 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277" returned: 0 in 0.437s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:05 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:05 devstack sudo[100387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277
Nov 03 17:04:05 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Acquiring lock "cinder-da1d55d7-7488-4a22-aa8f-ac05cd602234-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Lock "cinder-da1d55d7-7488-4a22-aa8f-ac05cd602234-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Acquiring lock "cinder-quobyte-da1d55d7-7488-4a22-aa8f-ac05cd602234" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:05 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] b586b990-9018-4e99-99be-107f66c9c06e was raw, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Lock "cinder-quobyte-da1d55d7-7488-4a22-aa8f-ac05cd602234" acquired by "delete_volume" :: waited 0.038s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:05 devstack sudo[100392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745
Nov 03 17:04:05 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db55078-66cb-49ba-958c-2ab577cd7791]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-da1d55d7-7488-4a22-aa8f-ac05cd602234 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:05 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277" returned: 0 in 0.313s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:05 devstack sudo[100396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.info
Nov 03 17:04:05 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:05 devstack sudo[100395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-da1d55d7-7488-4a22-aa8f-ac05cd602234
Nov 03 17:04:05 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:06 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.info" returned: 0 in 0.305s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:06 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:06 devstack sudo[100407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.info
Nov 03 17:04:06 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:06 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-da1d55d7-7488-4a22-aa8f-ac05cd602234" returned: 0 in 0.471s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-da1d55d7-7488-4a22-aa8f-ac05cd602234 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:06 devstack sudo[100410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-da1d55d7-7488-4a22-aa8f-ac05cd602234
Nov 03 17:04:06 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:06 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745" returned: 0 in 0.599s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b586b990-9018-4e99-99be-107f66c9c06e_pdw496sjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:04:06 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:06 devstack sudo[100412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745 1G
Nov 03 17:04:06 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:06 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.info" returned: 0 in 0.285s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.729s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:06 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-da1d55d7-7488-4a22-aa8f-ac05cd602234" returned: 0 in 0.332s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-02a9cd20-94cd-4ab0-91d6-77e2a2bcac56 tempest-GroupSnapshotsTest-373827168 None] group_snapshot 6c4d12fd-a922-40e4-aaa1-2fa87d9d6781: created successfully
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Lock "cinder-quobyte-da1d55d7-7488-4a22-aa8f-ac05cd602234" released by "delete_volume" :: held 0.876s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Created reservations ['13818a8f-5c7f-461e-9f85-74ad60650819', 'ea692288-0829-4b95-b063-9aac99dc5666', 'f3b07880-b177-46f5-ad5c-9f38e1def0b7', 'c075cd54-5173-4117-b7a7-82f0c05e6abd'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:06 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745 1G" returned: 0 in 0.386s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Downloaded image b586b990-9018-4e99-99be-107f66c9c06e ((None, [{'url': 'file:///opt/stack/data/glance/images/b586b990-9018-4e99-99be-107f66c9c06e', 'metadata': {}}])) to volume b8649c45-2136-40a0-9d82-aeb3a7cfa745 successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Temporary image b586b990-9018-4e99-99be-107f66c9c06e for user ccf57d1fa165452aafee4d17cdf9ee09 is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Marking volume b8649c45-2136-40a0-9d82-aeb3a7cfa745 as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Copying metadata from image b586b990-9018-4e99-99be-107f66c9c06e to b8649c45-2136-40a0-9d82-aeb3a7cfa745. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Creating volume glance metadata for volume b8649c45-2136-40a0-9d82-aeb3a7cfa745 backed by image b586b990-9018-4e99-99be-107f66c9c06e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b586b990-9018-4e99-99be-107f66c9c06e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1c84e1990cb462d2ea0785259c8b2e65', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:06 devstack sudo[100420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:06 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906ae054-0be4-489b-88b4-763c718cb42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745', 'volume_size': 1, 'image_id': 'b586b990-9018-4e99-99be-107f66c9c06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b586b990-9018-4e99-99be-107f66c9c06e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c84e1990cb462d2ea0785259c8b2e65', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '933c16c4515b44068f2dfd88280d6ce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9eabe09d3491e215cbded526ad9103a5f1b08420c8ba038d6021ac36eb9e61d024e8a737621924e12aefa058bc838543cc3861aeedbbdabb299fc59abdbd758', 'id': 'b586b990-9018-4e99-99be-107f66c9c06e', 'created_at': datetime.datetime(2026, 11, 3, 16, 3, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 3, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b586b990-9018-4e99-99be-107f66c9c06e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e723ab14050>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4974626-4111-40a8-a133-b5a35b428146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Volume volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745 (b8649c45-2136-40a0-9d82-aeb3a7cfa745): created successfully
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4974626-4111-40a8-a133-b5a35b428146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Flow 'volume_create_manager' (96844bf3-bcb7-4c2c-b0cb-58747c6c80f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-39a7d8b4-557f-4517-acd6-44934c34e785 tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Created volume successfully.
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Acquiring lock "cinder-b8649c45-2136-40a0-9d82-aeb3a7cfa745-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Lock "cinder-b8649c45-2136-40a0-9d82-aeb3a7cfa745-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:06 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.324s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:06 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Deleted volume successfully.
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Acquiring lock "cinder-quobyte-b8649c45-2136-40a0-9d82-aeb3a7cfa745" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cca4605-a016-44ec-b71e-feb87cb1c6d8 tempest-VolumesActionsTest-336551269 None] Lock "cinder-da1d55d7-7488-4a22-aa8f-ac05cd602234-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Lock "cinder-quobyte-b8649c45-2136-40a0-9d82-aeb3a7cfa745" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[051f003f-5516-4f01-9d37-08d2ebfd1e8b]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:07 devstack sudo[100425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745
Nov 03 17:04:07 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] group_snapshot 6c4d12fd-a922-40e4-aaa1-2fa87d9d6781: deleting
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] group_snapshot 6c4d12fd-a922-40e4-aaa1-2fa87d9d6781: deleting {{(pid=87122) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-bc54f517-5eb2-42f9-a3f5-13db2b1db770" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-bc54f517-5eb2-42f9-a3f5-13db2b1db770" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-db32b762-4eb9-4992-82ea-5bf8747ef277" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-db32b762-4eb9-4992-82ea-5bf8747ef277" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Deleting offline snapshot db32b762-4eb9-4992-82ea-5bf8747ef277 of volume bc54f517-5eb2-42f9-a3f5-13db2b1db770 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:04:07 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] snapshot_file for this snap is: volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745" returned: 0 in 0.700s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1a0325-3357-4896-b2b2-7ccc21467979]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:07 devstack sudo[100452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745
Nov 03 17:04:07 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:08 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277
Nov 03 17:04:08 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:08 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b8649c45-2136-40a0-9d82-aeb3a7cfa745" returned: 0 in 0.484s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Lock "cinder-quobyte-b8649c45-2136-40a0-9d82-aeb3a7cfa745" released by "delete_volume" :: held 1.257s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:08 devstack cinder-volume[87122]: WARNING cinder.quota [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:04:08 devstack cinder-volume[87122]: WARNING cinder.quota [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Created reservations ['e8c7ea74-1077-468e-a33b-2f2842704762', '6e7f1ff8-c0dd-484c-a86e-b68a2332dc23', '956a73b6-aa1d-41f3-91f0-8297c63ea584', '04cbc786-dc78-4812-9f91-b680c0c35be5'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:08 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277" returned: 0 in 0.710s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:04:08 devstack sudo[100460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:08 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfea9b1-9b87-4c92-bdd8-c54052a55c2e]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:08 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770
Nov 03 17:04:08 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:08 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.343s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Deleted volume successfully.
Nov 03 17:04:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a80fa109-0e73-4d91-8888-06088cf2f39a tempest-VolumeAndVolumeTypeFromImageTest-999360909 None] Lock "cinder-b8649c45-2136-40a0-9d82-aeb3a7cfa745-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:09 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770" returned: 0 in 0.599s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:09 devstack sudo[100470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277
Nov 03 17:04:09 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:09 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277" returned: 0 in 0.603s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:09 devstack sudo[100483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277
Nov 03 17:04:09 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:10 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770.db32b762-4eb9-4992-82ea-5bf8747ef277" returned: 0 in 0.324s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-db32b762-4eb9-4992-82ea-5bf8747ef277" released by "_delete_snapshot" :: held 2.422s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-bc54f517-5eb2-42f9-a3f5-13db2b1db770" released by "delete_snapshot" :: held 2.463s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:10 devstack cinder-volume[87122]: WARNING cinder.quota [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1938206808 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1938206808, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:04:10 devstack cinder-volume[87122]: WARNING cinder.quota [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1938206808 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1938206808, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] Created reservations ['c472c2f7-3ed6-45f3-a743-af06a88e6a60', 'bc052996-11cb-40a5-aa79-66d7982acbf2', '588a5f8a-2707-487b-9dda-03d81d531616', '93048fa4-d675-49f8-bf36-d33718086efc'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:10 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4c776a8b-4322-4531-8884-33b084aec6a9 tempest-GroupSnapshotsTest-373827168 None] group_snapshot 6c4d12fd-a922-40e4-aaa1-2fa87d9d6781: deleted successfully
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Flow 'volume_create_manager' (bd7d10b0-1bea-4728-a8ac-fbcfe5a97f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fde67f2-95c8-4259-868a-e6b2a8c321bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fde67f2-95c8-4259-868a-e6b2a8c321bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1448759815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a7bc02-bcb2-4170-94c3-83d052df9f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbeea83e1424854bef08a7f36229c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:11Z,use_quota=True,user_id='f3e4fe41fce64c9cbeb33f3999bd873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae634a70-460b-4a0b-add4-f1a8a9110593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae634a70-460b-4a0b-add4-f1a8a9110593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875aba39-0a99-49e0-ae66-d9a103a97016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875aba39-0a99-49e0-ae66-d9a103a97016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9a7bc02-bcb2-4170-94c3-83d052df9f1f', 'volume_name': 'volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96748bb-678c-4b76-aacd-76a585e9ade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96748bb-678c-4b76-aacd-76a585e9ade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffd1281-c34f-4dbd-93fc-b7978a59fa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:10 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Volume d9a7bc02-bcb2-4170-94c3-83d052df9f1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f', 'volume_size': 1}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1448759815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a7bc02-bcb2-4170-94c3-83d052df9f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbeea83e1424854bef08a7f36229c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:11Z,use_quota=True,user_id='f3e4fe41fce64c9cbeb33f3999bd873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Creating volume d9a7bc02-bcb2-4170-94c3-83d052df9f1f {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:10 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:10 devstack sudo[100487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f 1073741824
Nov 03 17:04:10 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:11 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f 1073741824" returned: 0 in 0.622s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:11 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f
Nov 03 17:04:11 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "cinder-quobyte-bc54f517-5eb2-42f9-a3f5-13db2b1db770" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-bc54f517-5eb2-42f9-a3f5-13db2b1db770" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:11 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6fe58a-909d-49e1-938e-9c9838e87223]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:11 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f" returned: 0 in 0.327s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffd1281-c34f-4dbd-93fc-b7978a59fa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b232e5d-49cd-47cd-8b18-e329ee6c469d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:12 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Volume volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f (d9a7bc02-bcb2-4170-94c3-83d052df9f1f): created successfully
Nov 03 17:04:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b232e5d-49cd-47cd-8b18-e329ee6c469d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Flow 'volume_create_manager' (bd7d10b0-1bea-4728-a8ac-fbcfe5a97f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-49fdb666-f3aa-4e01-8777-8c7dffbc0474 tempest-VolumesActionsTest-336551269 None] Created volume successfully.
Nov 03 17:04:12 devstack sudo[100497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770
Nov 03 17:04:12 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:12 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770" returned: 0 in 0.480s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:12 devstack sudo[100503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770
Nov 03 17:04:12 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:12 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc54f517-5eb2-42f9-a3f5-13db2b1db770" returned: 0 in 0.331s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Lock "cinder-quobyte-bc54f517-5eb2-42f9-a3f5-13db2b1db770" released by "delete_volume" :: held 0.942s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:12 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Created reservations ['1717d37c-a256-4ce5-a848-68f0a0d3bcb9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:12 devstack cinder-volume[87122]: WARNING cinder.quota [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1938206808 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1938206808, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:04:12 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Created reservations ['08e387f5-5798-4311-b47d-8be4ba955d94', '0a774b49-bea4-48bb-b3a0-c252875c1be5', 'b010b64e-695a-4d7d-8ea9-4e1d13aabc8d', '84568d66-8883-4629-b82d-2901457b78f3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:13 devstack sudo[100506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:13 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Acquiring lock "cinder-d9a7bc02-bcb2-4170-94c3-83d052df9f1f-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-d9a7bc02-bcb2-4170-94c3-83d052df9f1f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Acquiring lock "cinder-quobyte-d9a7bc02-bcb2-4170-94c3-83d052df9f1f" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-quobyte-d9a7bc02-bcb2-4170-94c3-83d052df9f1f" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc4590a-4dd6-407e-b5f1-729770a741ae]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:13 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.331s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-27fe83dc-0d15-4b69-af71-3c5276f03a09 tempest-GroupSnapshotsTest-373827168 None] Delete group completed successfully.
Nov 03 17:04:13 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f
Nov 03 17:04:13 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:13 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f" returned: 0 in 0.474s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:13 devstack sudo[100548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f
Nov 03 17:04:13 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:14 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d9a7bc02-bcb2-4170-94c3-83d052df9f1f" returned: 0 in 0.441s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-quobyte-d9a7bc02-bcb2-4170-94c3-83d052df9f1f" released by "delete_volume" :: held 0.975s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:14 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Created reservations ['31c9e6a6-ed48-474b-ab6a-fbbbefc13870', 'cb9156d1-2be0-40be-b4af-8c0ce1c8846d', '6390b659-6d34-4200-b944-8ff3b1b077b8', '3f1a138b-d80d-4a99-ac95-8370c15b0266'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:14 devstack sudo[100553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:14 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:14 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.342s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:14 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Deleted volume successfully.
Nov 03 17:04:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a82b529e-e334-439a-b9e2-5a5304c8a8b3 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-d9a7bc02-bcb2-4170-94c3-83d052df9f1f-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Flow 'volume_create_manager' (7ee419be-b226-42f5-9263-8db98d33adf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53dac7f-3259-4bfd-ba80-82780c815d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53dac7f-3259-4bfd-ba80-82780c815d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-486231849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71161a31-2243-4ef9-b2c9-c04752258bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd62be85e21b4d22ac1fc29760c7c877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:16Z,use_quota=True,user_id='ff9bd62e3bfc4cb885063d2f27feba74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361a083a-80b5-494d-8b08-441acd4b8947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361a083a-80b5-494d-8b08-441acd4b8947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f768a2-426e-4b45-96c3-232d0db379e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f768a2-426e-4b45-96c3-232d0db379e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71161a31-2243-4ef9-b2c9-c04752258bb4', 'volume_name': 'volume-71161a31-2243-4ef9-b2c9-c04752258bb4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a28c1d-41bc-4f01-83dc-227ff56b4bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a28c1d-41bc-4f01-83dc-227ff56b4bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f250998-63ea-499c-972b-91ac5a1957cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Volume 71161a31-2243-4ef9-b2c9-c04752258bb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71161a31-2243-4ef9-b2c9-c04752258bb4', 'volume_size': 1}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-486231849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71161a31-2243-4ef9-b2c9-c04752258bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd62be85e21b4d22ac1fc29760c7c877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:16Z,use_quota=True,user_id='ff9bd62e3bfc4cb885063d2f27feba74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Creating volume 71161a31-2243-4ef9-b2c9-c04752258bb4 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:16 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-71161a31-2243-4ef9-b2c9-c04752258bb4 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:16 devstack sudo[100557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-71161a31-2243-4ef9-b2c9-c04752258bb4 1073741824
Nov 03 17:04:16 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Flow 'volume_create_manager' (24985bc6-5910-46af-8f93-bf79ee695c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffac1322-8d26-465f-ae4a-3169ddbf108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffac1322-8d26-465f-ae4a-3169ddbf108a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-743911939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87eaab56-e4d4-422c-a284-ee21e55780b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbeea83e1424854bef08a7f36229c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:17Z,use_quota=True,user_id='f3e4fe41fce64c9cbeb33f3999bd873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a607c31b-57fc-4bee-9738-f99a63edfe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a607c31b-57fc-4bee-9738-f99a63edfe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a139bd17-d573-4098-8234-68d46022f5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a139bd17-d573-4098-8234-68d46022f5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87eaab56-e4d4-422c-a284-ee21e55780b5', 'volume_name': 'volume-87eaab56-e4d4-422c-a284-ee21e55780b5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a2db07-5f03-439c-b037-38b8880cbee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a2db07-5f03-439c-b037-38b8880cbee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cfd0e5-e61c-4b8b-a34f-6225d974d17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Volume 87eaab56-e4d4-422c-a284-ee21e55780b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87eaab56-e4d4-422c-a284-ee21e55780b5', 'volume_size': 1}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Flow 'volume_create_manager' (c52063a5-7e82-44e4-9db9-9e2f32b53728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d037a1-ab72-4e39-b38b-7cae4700202f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d037a1-ab72-4e39-b38b-7cae4700202f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-582957114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b728d6-3d06-490d-968a-a4c6e7a891ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd62be85e21b4d22ac1fc29760c7c877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:17Z,use_quota=True,user_id='ff9bd62e3bfc4cb885063d2f27feba74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72941d0-307a-4bac-8ced-91521b7141d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72941d0-307a-4bac-8ced-91521b7141d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c64c57-dee2-469d-94c7-54f51499ae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c64c57-dee2-469d-94c7-54f51499ae3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b728d6-3d06-490d-968a-a4c6e7a891ca', 'volume_name': 'volume-10b728d6-3d06-490d-968a-a4c6e7a891ca', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7065961-ad94-4efb-8ffd-7e1515763f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7065961-ad94-4efb-8ffd-7e1515763f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c83296-d4ba-426e-9653-bf1ca4aa1db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Volume 10b728d6-3d06-490d-968a-a4c6e7a891ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b728d6-3d06-490d-968a-a4c6e7a891ca', 'volume_size': 1}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:17 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-71161a31-2243-4ef9-b2c9-c04752258bb4 1073741824" returned: 0 in 0.705s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-71161a31-2243-4ef9-b2c9-c04752258bb4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:17 devstack sudo[100562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-71161a31-2243-4ef9-b2c9-c04752258bb4
Nov 03 17:04:17 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Flow 'volume_create_manager' (ceefe828-f224-4736-b40c-80e2d471db8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1f0e4d-de80-4655-a319-d5cfe90a61d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1f0e4d-de80-4655-a319-d5cfe90a61d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1561733709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f32673-49d4-4202-b8d2-ac000127dbca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd62be85e21b4d22ac1fc29760c7c877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:18Z,use_quota=True,user_id='ff9bd62e3bfc4cb885063d2f27feba74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef505ce-a305-429b-898e-514028669f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef505ce-a305-429b-898e-514028669f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed4cd94-e421-41f5-91c2-309c1758c39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed4cd94-e421-41f5-91c2-309c1758c39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f32673-49d4-4202-b8d2-ac000127dbca', 'volume_name': 'volume-c8f32673-49d4-4202-b8d2-ac000127dbca', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341bf156-a17a-4de5-a30d-cabc011a4feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341bf156-a17a-4de5-a30d-cabc011a4feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d717d32c-2fcc-4696-bc26-5e819998b852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Volume c8f32673-49d4-4202-b8d2-ac000127dbca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f32673-49d4-4202-b8d2-ac000127dbca', 'volume_size': 1}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-71161a31-2243-4ef9-b2c9-c04752258bb4" returned: 0 in 0.373s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-743911939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87eaab56-e4d4-422c-a284-ee21e55780b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbeea83e1424854bef08a7f36229c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:17Z,use_quota=True,user_id='f3e4fe41fce64c9cbeb33f3999bd873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Creating volume 87eaab56-e4d4-422c-a284-ee21e55780b5 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:17 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-87eaab56-e4d4-422c-a284-ee21e55780b5 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f250998-63ea-499c-972b-91ac5a1957cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71161a31-2243-4ef9-b2c9-c04752258bb4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack sudo[100565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-87eaab56-e4d4-422c-a284-ee21e55780b5 1073741824
Nov 03 17:04:17 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45123f71-f725-4f41-a1bf-be1c3e50f883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Volume volume-71161a31-2243-4ef9-b2c9-c04752258bb4 (71161a31-2243-4ef9-b2c9-c04752258bb4): created successfully
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45123f71-f725-4f41-a1bf-be1c3e50f883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Flow 'volume_create_manager' (7ee419be-b226-42f5-9263-8db98d33adf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-32595b35-6483-405b-a52c-f0f91b271fd9 tempest-CreateVolumesFromImageTest-47471438 None] Created volume successfully.
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Flow 'volume_create_manager' (18e9940d-48dd-4e1d-be69-f397c65cd292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1802ca-0138-472f-80c3-3884e01178d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1802ca-0138-472f-80c3-3884e01178d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945221690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd62be85e21b4d22ac1fc29760c7c877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:18Z,use_quota=True,user_id='ff9bd62e3bfc4cb885063d2f27feba74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12602df5-7857-4510-a026-39ff40c24f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12602df5-7857-4510-a026-39ff40c24f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7410500c-81b1-4a4f-a972-82445ab7c330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7410500c-81b1-4a4f-a972-82445ab7c330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3', 'volume_name': 'volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbb2877-dd4d-430c-a636-034029545bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbb2877-dd4d-430c-a636-034029545bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578b3766-ac1b-4127-878d-64ccdecab52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:18 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Volume 04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3', 'volume_size': 1}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:18 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-87eaab56-e4d4-422c-a284-ee21e55780b5 1073741824" returned: 0 in 0.751s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-87eaab56-e4d4-422c-a284-ee21e55780b5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:18 devstack sudo[100570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-87eaab56-e4d4-422c-a284-ee21e55780b5
Nov 03 17:04:18 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Flow 'volume_create_manager' (34ee50ae-737e-4580-b0b0-19a3c1d72817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f37f162-ffbe-4410-affa-b7ce45793bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f37f162-ffbe-4410-affa-b7ce45793bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1468138914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc643b93-f4a1-4573-adc3-51d262b39a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd62be85e21b4d22ac1fc29760c7c877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:19Z,use_quota=True,user_id='ff9bd62e3bfc4cb885063d2f27feba74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45018fdc-9f4f-4f36-a717-490c1cc2828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45018fdc-9f4f-4f36-a717-490c1cc2828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45020c96-6adc-4316-8fdd-a94b86634f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45020c96-6adc-4316-8fdd-a94b86634f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc643b93-f4a1-4573-adc3-51d262b39a0f', 'volume_name': 'volume-bc643b93-f4a1-4573-adc3-51d262b39a0f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d004c07-045f-49d4-bb2c-90c7a5b147ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d004c07-045f-49d4-bb2c-90c7a5b147ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4feedc56-b89a-45cb-9ee5-ff1e2848db60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Volume bc643b93-f4a1-4573-adc3-51d262b39a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc643b93-f4a1-4573-adc3-51d262b39a0f', 'volume_size': 1}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:19 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-87eaab56-e4d4-422c-a284-ee21e55780b5" returned: 0 in 0.393s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.758s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-582957114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b728d6-3d06-490d-968a-a4c6e7a891ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd62be85e21b4d22ac1fc29760c7c877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:17Z,use_quota=True,user_id='ff9bd62e3bfc4cb885063d2f27feba74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Creating volume 10b728d6-3d06-490d-968a-a4c6e7a891ca {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:19 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10b728d6-3d06-490d-968a-a4c6e7a891ca 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cfd0e5-e61c-4b8b-a34f-6225d974d17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87eaab56-e4d4-422c-a284-ee21e55780b5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698d06a9-af95-460e-ac30-9886f36e21b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:19 devstack sudo[100573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10b728d6-3d06-490d-968a-a4c6e7a891ca 1073741824
Nov 03 17:04:19 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Volume volume-87eaab56-e4d4-422c-a284-ee21e55780b5 (87eaab56-e4d4-422c-a284-ee21e55780b5): created successfully
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698d06a9-af95-460e-ac30-9886f36e21b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Flow 'volume_create_manager' (24985bc6-5910-46af-8f93-bf79ee695c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b12e71ab-2a0b-4caa-a6d2-dd4aba47da86 tempest-VolumesActionsTest-336551269 None] Created volume successfully.
Nov 03 17:04:19 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10b728d6-3d06-490d-968a-a4c6e7a891ca 1073741824" returned: 0 in 0.563s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10b728d6-3d06-490d-968a-a4c6e7a891ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:19 devstack sudo[100579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10b728d6-3d06-490d-968a-a4c6e7a891ca
Nov 03 17:04:19 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:19 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10b728d6-3d06-490d-968a-a4c6e7a891ca" returned: 0 in 0.308s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.227s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1561733709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f32673-49d4-4202-b8d2-ac000127dbca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd62be85e21b4d22ac1fc29760c7c877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:18Z,use_quota=True,user_id='ff9bd62e3bfc4cb885063d2f27feba74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Creating volume c8f32673-49d4-4202-b8d2-ac000127dbca {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:20 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8f32673-49d4-4202-b8d2-ac000127dbca 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:20 devstack sudo[100582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8f32673-49d4-4202-b8d2-ac000127dbca 1073741824
Nov 03 17:04:20 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c83296-d4ba-426e-9653-bf1ca4aa1db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b728d6-3d06-490d-968a-a4c6e7a891ca', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f33f439-f09c-4b52-98a4-aef7333c8f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Volume volume-10b728d6-3d06-490d-968a-a4c6e7a891ca (10b728d6-3d06-490d-968a-a4c6e7a891ca): created successfully
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f33f439-f09c-4b52-98a4-aef7333c8f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Flow 'volume_create_manager' (c52063a5-7e82-44e4-9db9-9e2f32b53728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c28b368f-b539-4f7c-94ab-d97613b3b98b tempest-CreateVolumesFromImageTest-47471438 None] Created volume successfully.
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Acquiring lock "cinder-87eaab56-e4d4-422c-a284-ee21e55780b5-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-87eaab56-e4d4-422c-a284-ee21e55780b5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Acquiring lock "cinder-quobyte-87eaab56-e4d4-422c-a284-ee21e55780b5" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-quobyte-87eaab56-e4d4-422c-a284-ee21e55780b5" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3751d16b-8ab6-45b8-8796-9f3870f835e5]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-87eaab56-e4d4-422c-a284-ee21e55780b5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:20 devstack sudo[100585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-87eaab56-e4d4-422c-a284-ee21e55780b5
Nov 03 17:04:20 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:20 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8f32673-49d4-4202-b8d2-ac000127dbca 1073741824" returned: 0 in 0.718s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8f32673-49d4-4202-b8d2-ac000127dbca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:20 devstack sudo[100593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8f32673-49d4-4202-b8d2-ac000127dbca
Nov 03 17:04:20 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:20 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-87eaab56-e4d4-422c-a284-ee21e55780b5" returned: 0 in 0.568s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-87eaab56-e4d4-422c-a284-ee21e55780b5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:20 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-87eaab56-e4d4-422c-a284-ee21e55780b5
Nov 03 17:04:20 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Flow 'volume_create_manager' (d563d529-5346-4507-a1a6-2a1ec2567959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ce7c16-5df3-4f04-977e-8933ab1fead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ce7c16-5df3-4f04-977e-8933ab1fead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1883535171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f60d5f9-ce5f-4df4-a354-4a482d1e313e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1393a25a634d5e947019bf786fa5f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:21Z,use_quota=True,user_id='b0ab5c5258aa4ef1a02db29d45866627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de84e46d-7ab7-48b4-a2d0-36815f20ff58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de84e46d-7ab7-48b4-a2d0-36815f20ff58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7397d1-9d02-4948-9950-424a52825a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7397d1-9d02-4948-9950-424a52825a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f60d5f9-ce5f-4df4-a354-4a482d1e313e', 'volume_name': 'volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497613d3-334f-48f2-9d94-3397ded666a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497613d3-334f-48f2-9d94-3397ded666a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff1e95-2f05-46ca-abaf-5337c3910c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:21 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Volume 4f60d5f9-ce5f-4df4-a354-4a482d1e313e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e', 'volume_size': 1}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:21 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8f32673-49d4-4202-b8d2-ac000127dbca" returned: 0 in 0.308s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.739s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945221690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd62be85e21b4d22ac1fc29760c7c877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:18Z,use_quota=True,user_id='ff9bd62e3bfc4cb885063d2f27feba74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Creating volume 04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:21 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d717d32c-2fcc-4696-bc26-5e819998b852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f32673-49d4-4202-b8d2-ac000127dbca', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:21 devstack sudo[100599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3 1073741824
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a7a6f1-304d-4a2e-bcf0-16ceeea70299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:21 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:21 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Volume volume-c8f32673-49d4-4202-b8d2-ac000127dbca (c8f32673-49d4-4202-b8d2-ac000127dbca): created successfully
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a7a6f1-304d-4a2e-bcf0-16ceeea70299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Flow 'volume_create_manager' (ceefe828-f224-4736-b40c-80e2d471db8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-91c4bb34-3ba2-48f7-987d-e8af3b165326 tempest-CreateVolumesFromImageTest-47471438 None] Created volume successfully.
Nov 03 17:04:21 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-87eaab56-e4d4-422c-a284-ee21e55780b5" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-quobyte-87eaab56-e4d4-422c-a284-ee21e55780b5" released by "delete_volume" :: held 0.902s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Created reservations ['0e8a2c30-49e3-4465-af4d-f2a87859a5c6', '36fe7cc0-74db-4ecb-b724-0dfce564e68e', 'c1214e72-489b-4286-a5cd-a179402440f4', 'e25d805a-0cd8-4598-b0c0-af27e4169c55'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:21 devstack sudo[100604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:21 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:21 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3 1073741824" returned: 0 in 0.577s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:21 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:21 devstack sudo[100609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3
Nov 03 17:04:21 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Deleted volume successfully.
Nov 03 17:04:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c2703504-deea-457e-a3e0-39645b5153e4 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-87eaab56-e4d4-422c-a284-ee21e55780b5-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:22 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3" returned: 0 in 0.329s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.090s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1468138914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc643b93-f4a1-4573-adc3-51d262b39a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd62be85e21b4d22ac1fc29760c7c877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:19Z,use_quota=True,user_id='ff9bd62e3bfc4cb885063d2f27feba74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Creating volume bc643b93-f4a1-4573-adc3-51d262b39a0f {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:22 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc643b93-f4a1-4573-adc3-51d262b39a0f 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:22 devstack sudo[100613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc643b93-f4a1-4573-adc3-51d262b39a0f 1073741824
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578b3766-ac1b-4127-878d-64ccdecab52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:22 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8199fc-d39b-4f74-b496-1c4b8dad38c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Volume volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3 (04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3): created successfully
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8199fc-d39b-4f74-b496-1c4b8dad38c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Flow 'volume_create_manager' (18e9940d-48dd-4e1d-be69-f397c65cd292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f2b97f09-7a27-4ccd-b5ff-a3f36a3baca9 tempest-CreateVolumesFromImageTest-47471438 None] Created volume successfully.
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Flow 'volume_create_manager' (d112b576-f95a-400b-a35d-56732f67a7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1fd3e8-6dc7-499b-bbd6-cf317174a77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1fd3e8-6dc7-499b-bbd6-cf317174a77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-280584781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3287b35a-ea12-4c60-b382-754e0b77e4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbeea83e1424854bef08a7f36229c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:22Z,use_quota=True,user_id='f3e4fe41fce64c9cbeb33f3999bd873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724ca69b-f176-4483-a64d-d177982273be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724ca69b-f176-4483-a64d-d177982273be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323acb34-3815-4f25-8e8b-a72c8379f5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323acb34-3815-4f25-8e8b-a72c8379f5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3287b35a-ea12-4c60-b382-754e0b77e4bd', 'volume_name': 'volume-3287b35a-ea12-4c60-b382-754e0b77e4bd', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d7608f-13e2-4c87-a921-ec60bcc14fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d7608f-13e2-4c87-a921-ec60bcc14fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfee745-e098-4167-aca5-89f004f91e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Volume 3287b35a-ea12-4c60-b382-754e0b77e4bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3287b35a-ea12-4c60-b382-754e0b77e4bd', 'volume_size': 1}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:22 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc643b93-f4a1-4573-adc3-51d262b39a0f 1073741824" returned: 0 in 0.481s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc643b93-f4a1-4573-adc3-51d262b39a0f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:22 devstack sudo[100618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc643b93-f4a1-4573-adc3-51d262b39a0f
Nov 03 17:04:22 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:22 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc643b93-f4a1-4573-adc3-51d262b39a0f" returned: 0 in 0.254s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.832s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1883535171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f60d5f9-ce5f-4df4-a354-4a482d1e313e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1393a25a634d5e947019bf786fa5f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:21Z,use_quota=True,user_id='b0ab5c5258aa4ef1a02db29d45866627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Creating volume 4f60d5f9-ce5f-4df4-a354-4a482d1e313e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:22 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4feedc56-b89a-45cb-9ee5-ff1e2848db60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc643b93-f4a1-4573-adc3-51d262b39a0f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a50fe2-41d2-4362-817a-fe393a9caabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:22 devstack sudo[100621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e 1073741824
Nov 03 17:04:22 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Volume volume-bc643b93-f4a1-4573-adc3-51d262b39a0f (bc643b93-f4a1-4573-adc3-51d262b39a0f): created successfully
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a50fe2-41d2-4362-817a-fe393a9caabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Flow 'volume_create_manager' (34ee50ae-737e-4580-b0b0-19a3c1d72817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a9153fc5-786e-4774-ae0a-7a1e1f1bf708 tempest-CreateVolumesFromImageTest-47471438 None] Created volume successfully.
Nov 03 17:04:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a0deb986-4b1b-488c-98a4-79f19e3d9481 tempest-GroupsTest-1827345132 None] Group tempest-Group1-1463358978: creating
Nov 03 17:04:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a0deb986-4b1b-488c-98a4-79f19e3d9481 tempest-GroupsTest-1827345132 None] Group tempest-Group1-1463358978: created successfully
Nov 03 17:04:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a0deb986-4b1b-488c-98a4-79f19e3d9481 tempest-GroupsTest-1827345132 None] Create group completed successfully.
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "cinder-bc643b93-f4a1-4573-adc3-51d262b39a0f-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-bc643b93-f4a1-4573-adc3-51d262b39a0f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "cinder-quobyte-bc643b93-f4a1-4573-adc3-51d262b39a0f" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-quobyte-bc643b93-f4a1-4573-adc3-51d262b39a0f" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a7c52d-e707-493f-8112-d490319f717f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc643b93-f4a1-4573-adc3-51d262b39a0f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:23 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e 1073741824" returned: 0 in 0.628s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:23 devstack sudo[100630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e
Nov 03 17:04:23 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:23 devstack sudo[100629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc643b93-f4a1-4573-adc3-51d262b39a0f
Nov 03 17:04:23 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:23 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e" returned: 0 in 0.246s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-280584781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3287b35a-ea12-4c60-b382-754e0b77e4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbeea83e1424854bef08a7f36229c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:22Z,use_quota=True,user_id='f3e4fe41fce64c9cbeb33f3999bd873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Creating volume 3287b35a-ea12-4c60-b382-754e0b77e4bd {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:23 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3287b35a-ea12-4c60-b382-754e0b77e4bd 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff1e95-2f05-46ca-abaf-5337c3910c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a540d7b6-565b-4cf7-975b-35579a5e567f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:23 devstack sudo[100637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3287b35a-ea12-4c60-b382-754e0b77e4bd 1073741824
Nov 03 17:04:23 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Volume volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e (4f60d5f9-ce5f-4df4-a354-4a482d1e313e): created successfully
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a540d7b6-565b-4cf7-975b-35579a5e567f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Flow 'volume_create_manager' (d563d529-5346-4507-a1a6-2a1ec2567959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:23 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc643b93-f4a1-4573-adc3-51d262b39a0f" returned: 0 in 0.381s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc643b93-f4a1-4573-adc3-51d262b39a0f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ba632091-d429-43e1-9537-867f6c5d4bd9 tempest-VolumeDependencyTests-316578749 None] Created volume successfully.
Nov 03 17:04:23 devstack sudo[100639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc643b93-f4a1-4573-adc3-51d262b39a0f
Nov 03 17:04:23 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:24 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc643b93-f4a1-4573-adc3-51d262b39a0f" returned: 0 in 0.336s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-quobyte-bc643b93-f4a1-4573-adc3-51d262b39a0f" released by "delete_volume" :: held 0.772s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Created reservations ['af7488a1-2fa3-4319-acb4-37af1a2a98ed', '4252ec89-f9bd-458b-8101-dd906be26ef1', '4e5a2645-fe17-43e8-85e6-c8387c8bc1ec', 'b8cb5976-b92c-48e1-a1ce-4321bb1022e9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:24 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3287b35a-ea12-4c60-b382-754e0b77e4bd 1073741824" returned: 0 in 0.635s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:24 devstack sudo[100646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:24 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3287b35a-ea12-4c60-b382-754e0b77e4bd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "cinder-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:24 devstack sudo[100648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3287b35a-ea12-4c60-b382-754e0b77e4bd
Nov 03 17:04:24 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7a733e8e-55ef-4c84-8eb1-6d4da9c10bad tempest-GroupsTest-1827345132 None] Group tempest-Group2-596014655: creating
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "cinder-quobyte-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-quobyte-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3" acquired by "delete_volume" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7a733e8e-55ef-4c84-8eb1-6d4da9c10bad tempest-GroupsTest-1827345132 None] Group tempest-Group2-596014655: created successfully
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[43115ac9-3583-4326-8eca-475aac52e9ca]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7a733e8e-55ef-4c84-8eb1-6d4da9c10bad tempest-GroupsTest-1827345132 None] Create group completed successfully.
Nov 03 17:04:24 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.386s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Deleted volume successfully.
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b3a4f9f9-064f-476a-ac33-2bda4560c1fc tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-bc643b93-f4a1-4573-adc3-51d262b39a0f-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:24 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:24 devstack sudo[100651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3287b35a-ea12-4c60-b382-754e0b77e4bd" returned: 0 in 0.362s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:24 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.385s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfee745-e098-4167-aca5-89f004f91e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3287b35a-ea12-4c60-b382-754e0b77e4bd', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b952a0f3-a555-4f92-bcc2-3182f4d2b866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] Creating offline snapshot dd1c4cf7-9002-46c8-a667-e92f6364afd6 of volume 4f60d5f9-ce5f-4df4-a354-4a482d1e313e {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:04:24 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Volume volume-3287b35a-ea12-4c60-b382-754e0b77e4bd (3287b35a-ea12-4c60-b382-754e0b77e4bd): created successfully
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b952a0f3-a555-4f92-bcc2-3182f4d2b866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Flow 'volume_create_manager' (d112b576-f95a-400b-a35d-56732f67a7f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f5a902-a660-48af-b9f3-86ea009fb82d]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-02979a4e-9d4b-473d-8d7c-5b924a9a093b tempest-VolumesActionsTest-336551269 None] Created volume successfully.
Nov 03 17:04:25 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e
Nov 03 17:04:25 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:25 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3" returned: 0 in 0.404s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:25 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3
Nov 03 17:04:25 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:25 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e" returned: 0 in 0.405s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:25 devstack sudo[100664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6 1G
Nov 03 17:04:25 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:25 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3" returned: 0 in 0.290s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-quobyte-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3" released by "delete_volume" :: held 0.767s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Created reservations ['51f1d355-e5ab-443e-90ac-7adc175f357e', '0ea31b11-0eb1-4fc0-a1cd-ae5e9ff0073d', '9037ea4f-853d-4480-8fc7-fd2ab2335355', '96a7f0c6-2a5e-4b26-a4f5-bfee1b4b1d32'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:25 devstack sudo[100670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:25 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "cinder-c8f32673-49d4-4202-b8d2-ac000127dbca-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Acquiring lock "cinder-3287b35a-ea12-4c60-b382-754e0b77e4bd-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-c8f32673-49d4-4202-b8d2-ac000127dbca-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Lock "cinder-3287b35a-ea12-4c60-b382-754e0b77e4bd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "cinder-quobyte-c8f32673-49d4-4202-b8d2-ac000127dbca" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Acquiring lock "cinder-quobyte-3287b35a-ea12-4c60-b382-754e0b77e4bd" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-quobyte-c8f32673-49d4-4202-b8d2-ac000127dbca" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Lock "cinder-quobyte-3287b35a-ea12-4c60-b382-754e0b77e4bd" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[74eea3d3-5eb7-4734-aab9-c55cf8884b62]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8f32673-49d4-4202-b8d2-ac000127dbca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:25 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6 1G" returned: 0 in 0.596s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc12dbcc-ba2c-48fd-9611-48c8676195c5]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3287b35a-ea12-4c60-b382-754e0b77e4bd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:26 devstack sudo[100673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6
Nov 03 17:04:26 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:26 devstack sudo[100672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8f32673-49d4-4202-b8d2-ac000127dbca
Nov 03 17:04:26 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:26 devstack sudo[100674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3287b35a-ea12-4c60-b382-754e0b77e4bd
Nov 03 17:04:26 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:26 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.431s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Deleted volume successfully.
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-426406a8-ac78-4442-b4df-3740dd088984 tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-04d5c6f6-6b3b-4412-970c-7f6c5f2e72e3-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:26 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6" returned: 0 in 0.441s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:26 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6 is being set with open permissions: ugo+rw
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:26 devstack sudo[100688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6
Nov 03 17:04:26 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:26 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3287b35a-ea12-4c60-b382-754e0b77e4bd" returned: 0 in 0.466s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3287b35a-ea12-4c60-b382-754e0b77e4bd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:26 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8f32673-49d4-4202-b8d2-ac000127dbca" returned: 0 in 0.527s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8f32673-49d4-4202-b8d2-ac000127dbca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:26 devstack sudo[100690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3287b35a-ea12-4c60-b382-754e0b77e4bd
Nov 03 17:04:26 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:26 devstack sudo[100692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8f32673-49d4-4202-b8d2-ac000127dbca
Nov 03 17:04:26 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Flow 'volume_create_manager' (0f88e08d-42f5-4473-851b-58acce9102b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060fa7ee-85d2-41aa-ac44-ee27cd614d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060fa7ee-85d2-41aa-ac44-ee27cd614d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-393424634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8bcbc21e-0093-4a32-bbed-ab4c42a80458,host='devstack@QuobyteHD#QuobyteHD',id=1e773360-7b24-46da-9f54-ff6140c2dc94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04e241485a64b7e89e95e1ad5175779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:27Z,use_quota=True,user_id='89cb510d53e0460b966053bc8bf4015b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c90a488a-ca52-4d33-9a72-d531ff0cbe82),volume_type_id=c90a488a-ca52-4d33-9a72-d531ff0cbe82)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227e0b3d-b3e7-43f2-96eb-a83ebedea7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227e0b3d-b3e7-43f2-96eb-a83ebedea7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:26 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c379a36-9eeb-46fb-a02b-1f15d393b77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c379a36-9eeb-46fb-a02b-1f15d393b77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e773360-7b24-46da-9f54-ff6140c2dc94', 'volume_name': 'volume-1e773360-7b24-46da-9f54-ff6140c2dc94', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:26 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13fae66b-a5e7-49f7-a35e-b3c3b556ec08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13fae66b-a5e7-49f7-a35e-b3c3b556ec08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b003a1e-9f4d-4de9-9e06-a3ef39fb9659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Volume 1e773360-7b24-46da-9f54-ff6140c2dc94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e773360-7b24-46da-9f54-ff6140c2dc94', 'volume_size': 1}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3287b35a-ea12-4c60-b382-754e0b77e4bd" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c8f32673-49d4-4202-b8d2-ac000127dbca" returned: 0 in 0.357s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:26 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6" returned: 0 in 0.447s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-quobyte-c8f32673-49d4-4202-b8d2-ac000127dbca" released by "delete_volume" :: held 0.968s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Lock "cinder-quobyte-3287b35a-ea12-4c60-b382-754e0b77e4bd" released by "delete_volume" :: held 0.941s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:26 devstack sudo[100697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.info
Nov 03 17:04:26 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Created reservations ['937b5bb4-224f-462e-b631-dae83f890307', '1891da08-9e86-4ad7-8d36-c31339df6c8c', 'cd7dd3db-a529-457b-ac53-659481cb04f3', '1ea79c9a-6405-4763-87ea-2d6b4b3b0f87'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Created reservations ['676beac4-a540-4ab2-a82e-c1c34e418e21', '933ae16f-6976-4dad-97f1-f742914e3993', 'f34cbdbc-0900-45f8-a240-73935be7dac3', '31e29530-e903-4532-bd46-514549760999'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:27 devstack sudo[100699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:27 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:27 devstack sudo[100701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:27 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:27 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.info" returned: 0 in 0.287s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:27 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.info is being set with open permissions: ugo+rw
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:27 devstack sudo[100704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.info
Nov 03 17:04:27 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:27 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.297s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:27 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Deleted volume successfully.
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-309f7433-9166-4031-af55-75a3b7847bfc tempest-VolumesActionsTest-1164560133 None] Lock "cinder-3287b35a-ea12-4c60-b382-754e0b77e4bd-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Deleted volume successfully.
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7698db57-0b07-4443-ab3e-1ad64e1fa3b6 tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-c8f32673-49d4-4202-b8d2-ac000127dbca-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:27 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.info" returned: 0 in 0.271s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.679s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8bcbc21e-0093-4a32-bbed-ab4c42a80458,created_at=2026-11-03T16:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-393424634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8bcbc21e-0093-4a32-bbed-ab4c42a80458,host='devstack@QuobyteHD#QuobyteHD',id=1e773360-7b24-46da-9f54-ff6140c2dc94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04e241485a64b7e89e95e1ad5175779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:27Z,use_quota=True,user_id='89cb510d53e0460b966053bc8bf4015b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c90a488a-ca52-4d33-9a72-d531ff0cbe82),volume_type_id=c90a488a-ca52-4d33-9a72-d531ff0cbe82)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Creating volume 1e773360-7b24-46da-9f54-ff6140c2dc94 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:27 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1e773360-7b24-46da-9f54-ff6140c2dc94 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:27 devstack sudo[100709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1e773360-7b24-46da-9f54-ff6140c2dc94 1073741824
Nov 03 17:04:27 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ebe6141d-d6d8-48a1-b27b-3cc1a8b608da tempest-VolumeDependencyTests-316578749 None] Create snapshot completed successfully
Nov 03 17:04:28 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1e773360-7b24-46da-9f54-ff6140c2dc94 1073741824" returned: 0 in 0.459s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1e773360-7b24-46da-9f54-ff6140c2dc94 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:28 devstack sudo[100715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1e773360-7b24-46da-9f54-ff6140c2dc94
Nov 03 17:04:28 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "cinder-10b728d6-3d06-490d-968a-a4c6e7a891ca-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-10b728d6-3d06-490d-968a-a4c6e7a891ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "cinder-quobyte-10b728d6-3d06-490d-968a-a4c6e7a891ca" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-quobyte-10b728d6-3d06-490d-968a-a4c6e7a891ca" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9be8992-e695-43b6-9472-ad24b7af2a5d]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10b728d6-3d06-490d-968a-a4c6e7a891ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:28 devstack sudo[100717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10b728d6-3d06-490d-968a-a4c6e7a891ca
Nov 03 17:04:28 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:28 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1e773360-7b24-46da-9f54-ff6140c2dc94" returned: 0 in 0.312s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b003a1e-9f4d-4de9-9e06-a3ef39fb9659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e773360-7b24-46da-9f54-ff6140c2dc94', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5687702c-872c-4952-8f88-c5ca3d42cab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:28 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Volume volume-1e773360-7b24-46da-9f54-ff6140c2dc94 (1e773360-7b24-46da-9f54-ff6140c2dc94): created successfully
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5687702c-872c-4952-8f88-c5ca3d42cab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Flow 'volume_create_manager' (0f88e08d-42f5-4473-851b-58acce9102b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a01fcec1-7b5d-46c0-95cb-e1af10fb0eba tempest-GroupsTest-1827345132 None] Created volume successfully.
Nov 03 17:04:28 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10b728d6-3d06-490d-968a-a4c6e7a891ca" returned: 0 in 0.427s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10b728d6-3d06-490d-968a-a4c6e7a891ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:28 devstack sudo[100723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10b728d6-3d06-490d-968a-a4c6e7a891ca
Nov 03 17:04:28 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Flow 'volume_create_manager' (dd227e41-f1bd-403b-b50b-d18d2eb15928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e9b832-9834-4159-a22d-8827f22da36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e9b832-9834-4159-a22d-8827f22da36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-503292237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b213102-023a-49c9-bdea-f22162dd8ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbeea83e1424854bef08a7f36229c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:29Z,use_quota=True,user_id='f3e4fe41fce64c9cbeb33f3999bd873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43aa502a-dc80-41bf-855a-d0e6dea86db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43aa502a-dc80-41bf-855a-d0e6dea86db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50dee307-39cd-4ca8-aa93-97d4b4d7426e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50dee307-39cd-4ca8-aa93-97d4b4d7426e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b213102-023a-49c9-bdea-f22162dd8ca2', 'volume_name': 'volume-0b213102-023a-49c9-bdea-f22162dd8ca2', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9ab970-228a-4ea5-9a2a-d7c0b7cd51b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9ab970-228a-4ea5-9a2a-d7c0b7cd51b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cad7ae1-6fd8-400e-84c3-b221dbbc7def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:28 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Volume 0b213102-023a-49c9-bdea-f22162dd8ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b213102-023a-49c9-bdea-f22162dd8ca2', 'volume_size': 1}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-503292237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b213102-023a-49c9-bdea-f22162dd8ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbeea83e1424854bef08a7f36229c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:29Z,use_quota=True,user_id='f3e4fe41fce64c9cbeb33f3999bd873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Creating volume 0b213102-023a-49c9-bdea-f22162dd8ca2 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:28 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0b213102-023a-49c9-bdea-f22162dd8ca2 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:28 devstack sudo[100725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0b213102-023a-49c9-bdea-f22162dd8ca2 1073741824
Nov 03 17:04:28 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:28 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-10b728d6-3d06-490d-968a-a4c6e7a891ca" returned: 0 in 0.295s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-quobyte-10b728d6-3d06-490d-968a-a4c6e7a891ca" released by "delete_volume" :: held 0.781s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Created reservations ['e02e6a3d-aea9-495c-8ae4-6a24669fd849', 'c8bcff23-99e8-4a8f-9eff-198b9f8f2885', 'c66e42c9-c7c8-4b77-8bd0-692c74658b16', '95c5001b-ddfa-405b-b1d0-9b8901f29a0d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:29 devstack sudo[100731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:29 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "cinder-71161a31-2243-4ef9-b2c9-c04752258bb4-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-71161a31-2243-4ef9-b2c9-c04752258bb4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Flow 'volume_create_manager' (14a709a8-27d1-48f8-ad99-83d2911a056d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dcc239e-d504-4ca3-b905-cf84dc3cdbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dcc239e-d504-4ca3-b905-cf84dc3cdbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1196548416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71d5d82-2a0d-407c-a071-f4b622c28c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1393a25a634d5e947019bf786fa5f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dd1c4cf7-9002-46c8-a667-e92f6364afd6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:29Z,use_quota=True,user_id='b0ab5c5258aa4ef1a02db29d45866627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853d3475-c81a-452a-8045-bb46a3bb5f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853d3475-c81a-452a-8045-bb46a3bb5f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d61c7eb-181e-407c-a716-17406c6224a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d61c7eb-181e-407c-a716-17406c6224a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c71d5d82-2a0d-407c-a071-f4b622c28c4e', 'volume_name': 'volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e', 'volume_size': 1, 'snapshot_id': 'dd1c4cf7-9002-46c8-a667-e92f6364afd6'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644e56d5-e91b-4727-bf99-4989e663663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:29 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644e56d5-e91b-4727-bf99-4989e663663e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f81153-0a33-4b2a-a28d-d67be0892274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:29 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Volume c71d5d82-2a0d-407c-a071-f4b622c28c4e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e', 'volume_size': 1, 'snapshot_id': 'dd1c4cf7-9002-46c8-a667-e92f6364afd6'}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "cinder-quobyte-71161a31-2243-4ef9-b2c9-c04752258bb4" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0b213102-023a-49c9-bdea-f22162dd8ca2 1073741824" returned: 0 in 0.672s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-quobyte-71161a31-2243-4ef9-b2c9-c04752258bb4" acquired by "delete_volume" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc31831-b0ca-42e8-9754-5c32b54d5b5e]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:29 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-71161a31-2243-4ef9-b2c9-c04752258bb4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0b213102-023a-49c9-bdea-f22162dd8ca2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.416s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Deleted volume successfully.
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae2c534b-08ea-4251-89e8-d7f205534897 tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-10b728d6-3d06-490d-968a-a4c6e7a891ca-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:29 devstack sudo[100736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0b213102-023a-49c9-bdea-f22162dd8ca2
Nov 03 17:04:29 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:29 devstack sudo[100735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-71161a31-2243-4ef9-b2c9-c04752258bb4
Nov 03 17:04:29 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:29 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0b213102-023a-49c9-bdea-f22162dd8ca2" returned: 0 in 0.324s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.384s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Acquiring lock "cinder-quobyte-dd1c4cf7-9002-46c8-a667-e92f6364afd6-c71d5d82-2a0d-407c-a071-f4b622c28c4e" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cad7ae1-6fd8-400e-84c3-b221dbbc7def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b213102-023a-49c9-bdea-f22162dd8ca2', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aff9101-b2ec-4197-b526-38792fe58af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Lock "cinder-quobyte-dd1c4cf7-9002-46c8-a667-e92f6364afd6-c71d5d82-2a0d-407c-a071-f4b622c28c4e" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Creating volume c71d5d82-2a0d-407c-a071-f4b622c28c4e from snapshot dd1c4cf7-9002-46c8-a667-e92f6364afd6 {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Acquiring lock "cinder-quobyte-c71d5d82-2a0d-407c-a071-f4b622c28c4e" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:29 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Volume volume-0b213102-023a-49c9-bdea-f22162dd8ca2 (0b213102-023a-49c9-bdea-f22162dd8ca2): created successfully
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aff9101-b2ec-4197-b526-38792fe58af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Flow 'volume_create_manager' (dd227e41-f1bd-403b-b50b-d18d2eb15928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Lock "cinder-quobyte-c71d5d82-2a0d-407c-a071-f4b622c28c4e" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] snapshot: dd1c4cf7-9002-46c8-a667-e92f6364afd6, volume: c71d5d82-2a0d-407c-a071-f4b622c28c4e,  {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 17:04:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-da59a695-000c-40c5-b62e-4f72609214c6 tempest-VolumesActionsTest-336551269 None] Created volume successfully.
Nov 03 17:04:30 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-71161a31-2243-4ef9-b2c9-c04752258bb4" returned: 0 in 0.445s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-71161a31-2243-4ef9-b2c9-c04752258bb4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:30 devstack sudo[100744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-71161a31-2243-4ef9-b2c9-c04752258bb4
Nov 03 17:04:30 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3194705-fe53-49f1-9b82-fc07f6686316]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Acquiring lock "cinder-quobyte-1e773360-7b24-46da-9f54-ff6140c2dc94" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Lock "cinder-quobyte-1e773360-7b24-46da-9f54-ff6140c2dc94" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[251f3e60-6b28-4c00-b3bd-baff33f7e20d]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1e773360-7b24-46da-9f54-ff6140c2dc94 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:30 devstack sudo[100746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6
Nov 03 17:04:30 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:30 devstack sudo[100748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1e773360-7b24-46da-9f54-ff6140c2dc94
Nov 03 17:04:30 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:30 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-71161a31-2243-4ef9-b2c9-c04752258bb4" returned: 0 in 0.338s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-quobyte-71161a31-2243-4ef9-b2c9-c04752258bb4" released by "delete_volume" :: held 0.834s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Created reservations ['a7df71a2-bf4a-490a-b0ce-d43eca522d75', 'c7ff3bee-961e-4c61-a926-efa76ce3e159', '4ee8903e-60fd-4629-8fe1-d6fa2f03b353', '4d64982a-4768-4b1d-928b-fcf6f13549cb'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:30 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6" returned: 0 in 0.449s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ba265e-5e29-46c0-ba26-9e7b35200564]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:30 devstack sudo[100759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:30 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:30 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1e773360-7b24-46da-9f54-ff6140c2dc94" returned: 0 in 0.412s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1e773360-7b24-46da-9f54-ff6140c2dc94 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:30 devstack sudo[100763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1e773360-7b24-46da-9f54-ff6140c2dc94
Nov 03 17:04:30 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:30 devstack sudo[100761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e
Nov 03 17:04:30 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:30 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.299s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:30 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Deleted volume successfully.
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aa05e824-65dc-4113-b793-a566683beb0e tempest-CreateVolumesFromImageTest-47471438 None] Lock "cinder-71161a31-2243-4ef9-b2c9-c04752258bb4-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:30 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1e773360-7b24-46da-9f54-ff6140c2dc94" returned: 0 in 0.329s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Lock "cinder-quobyte-1e773360-7b24-46da-9f54-ff6140c2dc94" released by "delete_volume" :: held 0.804s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:31 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e" returned: 0 in 0.481s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Path /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Created reservations ['ff2bac7c-7896-485b-beaf-b517b9127948'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Acquiring lock "cinder-0b213102-023a-49c9-bdea-f22162dd8ca2-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:31 devstack sudo[100771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e
Nov 03 17:04:31 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-0b213102-023a-49c9-bdea-f22162dd8ca2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:31 devstack cinder-volume[87122]: WARNING cinder.quota [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1173153761 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1173153761, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:04:31 devstack cinder-volume[87122]: WARNING cinder.quota [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1173153761 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1173153761, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Acquiring lock "cinder-quobyte-0b213102-023a-49c9-bdea-f22162dd8ca2" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Created reservations ['87942af8-3667-4db5-b493-986839867937', '8f133a48-931e-4f8c-a9b4-48cf5b1d4601', 'da2ef8eb-93f8-414f-8910-1874d2271261', '7e80bde7-411a-472e-a59b-d0eff1320b1f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-quobyte-0b213102-023a-49c9-bdea-f22162dd8ca2" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b59569f-04cd-4505-bc9f-bbf7d0c30771]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0b213102-023a-49c9-bdea-f22162dd8ca2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:31 devstack sudo[100777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:31 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:31 devstack sudo[100773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0b213102-023a-49c9-bdea-f22162dd8ca2
Nov 03 17:04:31 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-f0ed9ef5-4659-4295-ba9c-a8218edcee10 tempest-GroupsTest-1827345132 None] Created reservations ['f6e80a62-ece1-4f6b-a927-0161953e7e9e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f0ed9ef5-4659-4295-ba9c-a8218edcee10 tempest-GroupsTest-1827345132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f0ed9ef5-4659-4295-ba9c-a8218edcee10 tempest-GroupsTest-1827345132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f0ed9ef5-4659-4295-ba9c-a8218edcee10 tempest-GroupsTest-1827345132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f0ed9ef5-4659-4295-ba9c-a8218edcee10 tempest-GroupsTest-1827345132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f0ed9ef5-4659-4295-ba9c-a8218edcee10 tempest-GroupsTest-1827345132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0ed9ef5-4659-4295-ba9c-a8218edcee10 tempest-GroupsTest-1827345132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:31 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.441s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-988f872a-6bc9-4677-ab13-19a9cde50a6f tempest-GroupsTest-1827345132 None] Delete group completed successfully.
Nov 03 17:04:31 devstack sudo[100791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:31 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:31 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0b213102-023a-49c9-bdea-f22162dd8ca2" returned: 0 in 0.642s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0b213102-023a-49c9-bdea-f22162dd8ca2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:31 devstack sudo[100793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0b213102-023a-49c9-bdea-f22162dd8ca2
Nov 03 17:04:31 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:32 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0ed9ef5-4659-4295-ba9c-a8218edcee10 tempest-GroupsTest-1827345132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.567s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:32 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-f0ed9ef5-4659-4295-ba9c-a8218edcee10 tempest-GroupsTest-1827345132 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f0ed9ef5-4659-4295-ba9c-a8218edcee10 tempest-GroupsTest-1827345132 None] Delete group completed successfully.
Nov 03 17:04:32 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0b213102-023a-49c9-bdea-f22162dd8ca2" returned: 0 in 0.506s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-quobyte-0b213102-023a-49c9-bdea-f22162dd8ca2" released by "delete_volume" :: held 1.228s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:32 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Created reservations ['e4b4b9c0-cca4-44b4-88bf-48e5b014df4a', 'ed66e592-551d-42b0-bfcb-187b1896eb51', '78ff8256-3ab3-4a41-9918-c9c059946247', '718fe13e-b054-45d9-95e0-8dbb7f4db0dc'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:32 devstack sudo[100798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:32 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:33 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.727s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:33 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Deleted volume successfully.
Nov 03 17:04:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-762bc881-fb50-4675-ad94-3fa9cd36d814 tempest-VolumesActionsTest-1164560133 None] Lock "cinder-0b213102-023a-49c9-bdea-f22162dd8ca2-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8ccef701-9e9e-4a23-8dec-b6ff77ca06e4 tempest-GroupsTest-1827345132 None] Group tempest-GroupsTest-Group-2033482384: creating
Nov 03 17:04:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8ccef701-9e9e-4a23-8dec-b6ff77ca06e4 tempest-GroupsTest-1827345132 None] Group tempest-GroupsTest-Group-2033482384: created successfully
Nov 03 17:04:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8ccef701-9e9e-4a23-8dec-b6ff77ca06e4 tempest-GroupsTest-1827345132 None] Create group completed successfully.
Nov 03 17:04:34 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Flow 'volume_create_manager' (85278cd7-d0be-42e9-8300-5fa4de0412ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d14e7af-6943-47b3-980c-f4e9d145531c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d14e7af-6943-47b3-980c-f4e9d145531c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1864243327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07394362-6cd7-4ff3-8a50-89887a0695c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbeea83e1424854bef08a7f36229c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:35Z,use_quota=True,user_id='f3e4fe41fce64c9cbeb33f3999bd873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b3e9c6-f839-402a-80e4-a3fa8ea845d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b3e9c6-f839-402a-80e4-a3fa8ea845d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43787d26-39fe-431f-adaf-c31751721db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43787d26-39fe-431f-adaf-c31751721db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07394362-6cd7-4ff3-8a50-89887a0695c5', 'volume_name': 'volume-07394362-6cd7-4ff3-8a50-89887a0695c5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa95413-0832-4e9e-bda5-625d5b5a1c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa95413-0832-4e9e-bda5-625d5b5a1c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1b9a53-9423-4473-b470-e095979eb223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:34 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Volume 07394362-6cd7-4ff3-8a50-89887a0695c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07394362-6cd7-4ff3-8a50-89887a0695c5', 'volume_size': 1}
Nov 03 17:04:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:36 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Flow 'volume_create_manager' (004facbf-127a-4678-9907-28586eb364e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade2f486-90ce-45f0-9d99-b9cc2d44cd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade2f486-90ce-45f0-9d99-b9cc2d44cd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-885260229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6b6dd5e5-de86-4525-92a0-cf098fe3794e,host='devstack@QuobyteHD#QuobyteHD',id=8ba05fb6-0ecb-4143-a09a-3b564e6375ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04e241485a64b7e89e95e1ad5175779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:36Z,use_quota=True,user_id='89cb510d53e0460b966053bc8bf4015b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62410242-e321-47ed-979f-6cb3cc5fd34d),volume_type_id=62410242-e321-47ed-979f-6cb3cc5fd34d)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9863894-5b23-4070-8a56-7ab55d464d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9863894-5b23-4070-8a56-7ab55d464d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adacaa93-6f3e-4a32-840e-4d908e93758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adacaa93-6f3e-4a32-840e-4d908e93758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba05fb6-0ecb-4143-a09a-3b564e6375ec', 'volume_name': 'volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04177515-2140-4075-8518-ab9368a37df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04177515-2140-4075-8518-ab9368a37df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d54c4ad-5908-4b86-9166-5b38fbed501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:36 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Volume 8ba05fb6-0ecb-4143-a09a-3b564e6375ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec', 'volume_size': 1}
Nov 03 17:04:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:38 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Flow 'volume_create_manager' (c88f7e3e-8929-4082-97a1-dd30cb861032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca15b1c9-bcdc-4102-b0b7-6d5e7eae177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca15b1c9-bcdc-4102-b0b7-6d5e7eae177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2124404115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e8f919bcbf41e59551e6c3479f064d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:38Z,use_quota=True,user_id='3064deeecd5649f4b363a38dfb2090d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3b91f7-3db8-4aa6-9d13-d8e9d394b0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3b91f7-3db8-4aa6-9d13-d8e9d394b0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1639be07-e918-4885-b3d9-613aa93d27cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1639be07-e918-4885-b3d9-613aa93d27cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7', 'volume_name': 'volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c00768-4953-4655-89bd-3920ec54322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c00768-4953-4655-89bd-3920ec54322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c470176-e158-4b71-ae44-487935f78d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:38 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7', 'volume_size': 1}
Nov 03 17:04:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:39 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e" returned: 0 in 8.065s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e, size 1024.00 MB, duration 8.07 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:04:39 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Converted 1024.00 MB image at 126.96 MB/s
Nov 03 17:04:39 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e is being set with open permissions: ugo+rw
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:39 devstack sudo[100802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e
Nov 03 17:04:39 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:39 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e" returned: 0 in 0.241s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Lock "cinder-quobyte-c71d5d82-2a0d-407c-a071-f4b622c28c4e" released by "_copy_volume_from_snapshot" :: held 9.377s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Lock "cinder-quobyte-dd1c4cf7-9002-46c8-a667-e92f6364afd6-c71d5d82-2a0d-407c-a071-f4b622c28c4e" released by "_create_volume_from_snapshot" :: held 9.455s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.495s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.458s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1864243327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07394362-6cd7-4ff3-8a50-89887a0695c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbeea83e1424854bef08a7f36229c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:35Z,use_quota=True,user_id='f3e4fe41fce64c9cbeb33f3999bd873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Creating volume 07394362-6cd7-4ff3-8a50-89887a0695c5 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:39 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07394362-6cd7-4ff3-8a50-89887a0695c5 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:39 devstack sudo[100805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07394362-6cd7-4ff3-8a50-89887a0695c5 1073741824
Nov 03 17:04:39 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f81153-0a33-4b2a-a28d-d67be0892274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e', 'volume_size': 1, 'snapshot_id': 'dd1c4cf7-9002-46c8-a667-e92f6364afd6'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cf6773-3865-4848-a4ed-2d298bacdda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Volume volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e (c71d5d82-2a0d-407c-a071-f4b622c28c4e): created successfully
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cf6773-3865-4848-a4ed-2d298bacdda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Flow 'volume_create_manager' (14a709a8-27d1-48f8-ad99-83d2911a056d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ffee87fa-557e-4ffc-9d2d-67bef00cd046 tempest-VolumeDependencyTests-316578749 None] Created volume successfully.
Nov 03 17:04:39 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07394362-6cd7-4ff3-8a50-89887a0695c5 1073741824" returned: 0 in 0.411s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07394362-6cd7-4ff3-8a50-89887a0695c5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:39 devstack sudo[100811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07394362-6cd7-4ff3-8a50-89887a0695c5
Nov 03 17:04:39 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:40 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07394362-6cd7-4ff3-8a50-89887a0695c5" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.615s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6b6dd5e5-de86-4525-92a0-cf098fe3794e,created_at=2026-11-03T16:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-885260229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6b6dd5e5-de86-4525-92a0-cf098fe3794e,host='devstack@QuobyteHD#QuobyteHD',id=8ba05fb6-0ecb-4143-a09a-3b564e6375ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04e241485a64b7e89e95e1ad5175779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:36Z,use_quota=True,user_id='89cb510d53e0460b966053bc8bf4015b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62410242-e321-47ed-979f-6cb3cc5fd34d),volume_type_id=62410242-e321-47ed-979f-6cb3cc5fd34d)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Creating volume 8ba05fb6-0ecb-4143-a09a-3b564e6375ec {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:40 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1b9a53-9423-4473-b470-e095979eb223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07394362-6cd7-4ff3-8a50-89887a0695c5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:40 devstack sudo[100814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec 1073741824
Nov 03 17:04:40 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bb47fe-c365-414e-b33b-8048caad930b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Volume volume-07394362-6cd7-4ff3-8a50-89887a0695c5 (07394362-6cd7-4ff3-8a50-89887a0695c5): created successfully
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bb47fe-c365-414e-b33b-8048caad930b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Flow 'volume_create_manager' (85278cd7-d0be-42e9-8300-5fa4de0412ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1f8adabf-9b60-43d5-ae8f-cef31b934a16 tempest-VolumesActionsTest-336551269 None] Created volume successfully.
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Acquiring lock "cinder-dd1c4cf7-9002-46c8-a667-e92f6364afd6-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Lock "cinder-dd1c4cf7-9002-46c8-a667-e92f6364afd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Acquiring lock "cinder-quobyte-4f60d5f9-ce5f-4df4-a354-4a482d1e313e" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Lock "cinder-quobyte-4f60d5f9-ce5f-4df4-a354-4a482d1e313e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Acquiring lock "cinder-quobyte-dd1c4cf7-9002-46c8-a667-e92f6364afd6" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Lock "cinder-quobyte-dd1c4cf7-9002-46c8-a667-e92f6364afd6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Deleting offline snapshot dd1c4cf7-9002-46c8-a667-e92f6364afd6 of volume 4f60d5f9-ce5f-4df4-a354-4a482d1e313e {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] snapshot_file for this snap is: volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0929063-44f0-499b-ab7e-50caebcf558e]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:40 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec 1073741824" returned: 0 in 0.471s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:40 devstack sudo[100822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6
Nov 03 17:04:40 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:40 devstack sudo[100824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec
Nov 03 17:04:40 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:40 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6" returned: 0 in 0.374s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:04:40 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec" returned: 0 in 0.269s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.747s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2124404115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e8f919bcbf41e59551e6c3479f064d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:38Z,use_quota=True,user_id='3064deeecd5649f4b363a38dfb2090d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Creating volume bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:40 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0bd0e2-0f6e-48e3-bfc3-b298496fe5af]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:40 devstack sudo[100830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 1073741824
Nov 03 17:04:40 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d54c4ad-5908-4b86-9166-5b38fbed501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (247eb80b-27b4-474b-a1e3-10c6b764b4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Volume volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec (8ba05fb6-0ecb-4143-a09a-3b564e6375ec): created successfully
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (247eb80b-27b4-474b-a1e3-10c6b764b4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Flow 'volume_create_manager' (004facbf-127a-4678-9907-28586eb364e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8ac801fd-fdb5-4f91-b5f4-10aaa97d9d73 tempest-GroupsTest-1827345132 None] Created volume successfully.
Nov 03 17:04:41 devstack sudo[100831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e
Nov 03 17:04:41 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 1073741824" returned: 0 in 0.567s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:41 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:41 devstack sudo[100841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7
Nov 03 17:04:41 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:41 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e" returned: 0 in 0.659s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:41 devstack sudo[100843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6
Nov 03 17:04:41 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:41 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7" returned: 0 in 0.362s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c470176-e158-4b71-ae44-487935f78d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3730a3-b9a0-459a-8136-9282189bcdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 (bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7): created successfully
Nov 03 17:04:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3730a3-b9a0-459a-8136-9282189bcdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Flow 'volume_create_manager' (c88f7e3e-8929-4082-97a1-dd30cb861032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b356cff6-3771-4946-81d1-265863bf276a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Created volume successfully.
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Flow 'volume_create_manager' (0f27db97-5343-4dbf-a86b-3f1e239b2114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1725d9e1-db3f-4282-8f4e-f7cbaf627cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1725d9e1-db3f-4282-8f4e-f7cbaf627cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2010934990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6b6dd5e5-de86-4525-92a0-cf098fe3794e,host='devstack@QuobyteHD#QuobyteHD',id=809428a1-f3bd-4d44-a183-66db046a9cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04e241485a64b7e89e95e1ad5175779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:42Z,use_quota=True,user_id='89cb510d53e0460b966053bc8bf4015b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62410242-e321-47ed-979f-6cb3cc5fd34d),volume_type_id=62410242-e321-47ed-979f-6cb3cc5fd34d)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42127795-ae98-4de2-aa52-9a7dca6d715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42127795-ae98-4de2-aa52-9a7dca6d715c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d70649-4dd9-458f-b0bd-ec3d184ccb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d70649-4dd9-458f-b0bd-ec3d184ccb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '809428a1-f3bd-4d44-a183-66db046a9cbd', 'volume_name': 'volume-809428a1-f3bd-4d44-a183-66db046a9cbd', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c79403e-3cb6-4472-8351-d5eb68c3fdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c79403e-3cb6-4472-8351-d5eb68c3fdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a3bed9-72b0-4d8f-a3f3-21b8b6261b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Volume 809428a1-f3bd-4d44-a183-66db046a9cbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-809428a1-f3bd-4d44-a183-66db046a9cbd', 'volume_size': 1}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6b6dd5e5-de86-4525-92a0-cf098fe3794e,created_at=2026-11-03T16:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2010934990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6b6dd5e5-de86-4525-92a0-cf098fe3794e,host='devstack@QuobyteHD#QuobyteHD',id=809428a1-f3bd-4d44-a183-66db046a9cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04e241485a64b7e89e95e1ad5175779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:42Z,use_quota=True,user_id='89cb510d53e0460b966053bc8bf4015b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62410242-e321-47ed-979f-6cb3cc5fd34d),volume_type_id=62410242-e321-47ed-979f-6cb3cc5fd34d)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Creating volume 809428a1-f3bd-4d44-a183-66db046a9cbd {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:42 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-809428a1-f3bd-4d44-a183-66db046a9cbd 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:42 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6" returned: 0 in 0.575s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:42 devstack sudo[100850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-809428a1-f3bd-4d44-a183-66db046a9cbd 1073741824
Nov 03 17:04:42 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Acquiring lock "cinder-07394362-6cd7-4ff3-8a50-89887a0695c5-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:42 devstack sudo[100851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6
Nov 03 17:04:42 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Lock "cinder-07394362-6cd7-4ff3-8a50-89887a0695c5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Acquiring lock "cinder-quobyte-07394362-6cd7-4ff3-8a50-89887a0695c5" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Lock "cinder-quobyte-07394362-6cd7-4ff3-8a50-89887a0695c5" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0136bc3e-8108-495c-8411-6b8e23f7b5f9]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07394362-6cd7-4ff3-8a50-89887a0695c5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:42 devstack sudo[100854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07394362-6cd7-4ff3-8a50-89887a0695c5
Nov 03 17:04:42 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:42 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e.dd1c4cf7-9002-46c8-a667-e92f6364afd6" returned: 0 in 0.338s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Lock "cinder-quobyte-dd1c4cf7-9002-46c8-a667-e92f6364afd6" released by "_delete_snapshot" :: held 2.112s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Lock "cinder-quobyte-4f60d5f9-ce5f-4df4-a354-4a482d1e313e" released by "delete_snapshot" :: held 2.142s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Created reservations ['3b98e0a6-4cb0-4043-ac05-cf8cc415f300', '9dee4a94-27e4-4cff-83c7-a8b1a2bbd491', 'ea90f6f7-e159-446b-8665-092aa48686da', '3163cc7e-b7ad-4a15-9bd5-5c274f037780'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Delete snapshot completed successfully.
Nov 03 17:04:42 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-809428a1-f3bd-4d44-a183-66db046a9cbd 1073741824" returned: 0 in 0.617s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e12820-6bf4-4831-9d27-03fe953bfa9c tempest-VolumeDependencyTests-316578749 None] Lock "cinder-dd1c4cf7-9002-46c8-a667-e92f6364afd6-delete_snapshot" released by "delete_snapshot" :: held 2.361s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:42 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-809428a1-f3bd-4d44-a183-66db046a9cbd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07394362-6cd7-4ff3-8a50-89887a0695c5" returned: 0 in 0.493s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07394362-6cd7-4ff3-8a50-89887a0695c5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:42 devstack sudo[100864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-809428a1-f3bd-4d44-a183-66db046a9cbd
Nov 03 17:04:42 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:42 devstack sudo[100865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07394362-6cd7-4ff3-8a50-89887a0695c5
Nov 03 17:04:42 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:43 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-809428a1-f3bd-4d44-a183-66db046a9cbd" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.351s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:43 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a3bed9-72b0-4d8f-a3f3-21b8b6261b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-809428a1-f3bd-4d44-a183-66db046a9cbd', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cad4052-2f0c-40da-99ff-ff1f44050d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07394362-6cd7-4ff3-8a50-89887a0695c5" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Creating offline snapshot 3607c3a7-b607-468e-8629-c914fd582d13 of volume bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:04:43 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Volume volume-809428a1-f3bd-4d44-a183-66db046a9cbd (809428a1-f3bd-4d44-a183-66db046a9cbd): created successfully
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cad4052-2f0c-40da-99ff-ff1f44050d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Flow 'volume_create_manager' (0f27db97-5343-4dbf-a86b-3f1e239b2114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Lock "cinder-quobyte-07394362-6cd7-4ff3-8a50-89887a0695c5" released by "delete_volume" :: held 0.842s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e149e259-f97d-4c98-a90a-405730246c27]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fd6e5a9d-7a6b-4a49-8a43-4e3eb7ab9ed2 tempest-GroupsTest-1827345132 None] Created volume successfully.
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Created reservations ['ede0cec7-98b6-4e66-9514-9b0dfdb033cb', 'bd3bd754-0704-4d35-af85-1bd52074f1f9', 'ee29adbe-2d5e-478e-a1f5-dfc976063614', '867e7aaf-ce13-46b5-b1a5-d1d9e5b5fab1'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:43 devstack sudo[100872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7
Nov 03 17:04:43 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:43 devstack sudo[100874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:43 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-809132c6-260d-43b9-89ff-d12a3d1b8c30 tempest-GroupsTest-1827345132 None] Update group completed successfully.
Nov 03 17:04:43 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:43 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.297s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Deleted volume successfully.
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7" returned: 0 in 0.489s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:43 devstack sudo[100881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13 1G
Nov 03 17:04:43 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b6f9c495-c7ea-47cb-abfe-efe6da3f7164 tempest-VolumesActionsTest-336551269 None] Lock "cinder-07394362-6cd7-4ff3-8a50-89887a0695c5-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Acquiring lock "cinder-4f60d5f9-ce5f-4df4-a354-4a482d1e313e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Lock "cinder-4f60d5f9-ce5f-4df4-a354-4a482d1e313e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Acquiring lock "cinder-quobyte-4f60d5f9-ce5f-4df4-a354-4a482d1e313e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Lock "cinder-quobyte-4f60d5f9-ce5f-4df4-a354-4a482d1e313e" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c14c832-8ec2-46da-845c-5e67586e2984]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:44 devstack sudo[100883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e
Nov 03 17:04:44 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:44 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13 1G" returned: 0 in 0.551s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:44 devstack sudo[100888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13
Nov 03 17:04:44 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:44 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e" returned: 0 in 0.409s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:44 devstack sudo[100893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e
Nov 03 17:04:44 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:44 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13" returned: 0 in 0.374s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:44 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13 is being set with open permissions: ugo+rw
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:44 devstack sudo[100900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13
Nov 03 17:04:44 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:44 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f60d5f9-ce5f-4df4-a354-4a482d1e313e" returned: 0 in 0.316s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Lock "cinder-quobyte-4f60d5f9-ce5f-4df4-a354-4a482d1e313e" released by "delete_volume" :: held 0.806s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Created reservations ['217ece04-d475-4c31-95fd-17a3f8a6890b', '2a6ee57d-468f-4696-8bee-c29d934c71af', 'b19b3169-1dda-4b02-afdc-956b059208c6', 'e1597af2-1cc5-48b4-b9fb-944ecd7b1626'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:44 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13" returned: 0 in 0.332s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:44 devstack sudo[100903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:44 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Acquiring lock "cinder-c71d5d82-2a0d-407c-a071-f4b622c28c4e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:45 devstack sudo[100905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.info
Nov 03 17:04:45 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f1e91770-2ba8-4645-9a7f-bd6f62d81a45 tempest-GroupsTest-1827345132 None] Update group completed successfully.
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Lock "cinder-c71d5d82-2a0d-407c-a071-f4b622c28c4e-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Acquiring lock "cinder-quobyte-c71d5d82-2a0d-407c-a071-f4b622c28c4e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Lock "cinder-quobyte-c71d5d82-2a0d-407c-a071-f4b622c28c4e" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5af4e1-bc98-4fd5-83fd-b92b2c496624]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:45 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.info" returned: 0 in 0.349s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:45 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.info is being set with open permissions: ugo+rw
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:45 devstack sudo[100907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e
Nov 03 17:04:45 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:45 devstack sudo[100910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.info
Nov 03 17:04:45 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:45 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.467s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Deleted volume successfully.
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=172,cinder:UPDATE=225,cinder:INSERT=59,cinder:DELETE=17 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-686cf152-9c49-4ec4-bf14-f55120de4b89 tempest-VolumeDependencyTests-316578749 None] Lock "cinder-4f60d5f9-ce5f-4df4-a354-4a482d1e313e-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:45 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e" returned: 0 in 0.436s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:45 devstack sudo[100918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e
Nov 03 17:04:45 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:45 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.info" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.658s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-715c6706-6bb2-475d-95b7-824b67235012 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Create snapshot completed successfully
Nov 03 17:04:45 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c71d5d82-2a0d-407c-a071-f4b622c28c4e" returned: 0 in 0.288s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Lock "cinder-quobyte-c71d5d82-2a0d-407c-a071-f4b622c28c4e" released by "delete_volume" :: held 0.794s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Created reservations ['061f9d64-a1ba-4bb8-a847-611b0c185f8d', '140bec54-3084-4fe8-9566-be1757f3208c', '2011cdd6-ec24-45d4-a302-9c8e584882f7', 'b2d52b3a-07ae-498f-af4c-fa2ee8b15dc8'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:46 devstack sudo[100921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:46 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:46 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.390s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Deleted volume successfully.
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d25ee822-31c4-4bc3-a2a5-9b48a1acb3f9 tempest-VolumeDependencyTests-316578749 None] Lock "cinder-c71d5d82-2a0d-407c-a071-f4b622c28c4e-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Flow 'volume_create_manager' (1eb653f0-3022-4d8c-8405-fe5ee08ddceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f2a0dd-41d5-45a0-b434-2bca8c9aabfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f2a0dd-41d5-45a0-b434-2bca8c9aabfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2111549479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0034ac80-74db-40d9-b098-5f415e643c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e8f919bcbf41e59551e6c3479f064d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:47Z,use_quota=True,user_id='3064deeecd5649f4b363a38dfb2090d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5368bc47-047d-44b8-8ed5-97b8fdb1b2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5368bc47-047d-44b8-8ed5-97b8fdb1b2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18da0066-d408-4899-ae4f-e4bb5abd4562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18da0066-d408-4899-ae4f-e4bb5abd4562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0034ac80-74db-40d9-b098-5f415e643c39', 'volume_name': 'volume-0034ac80-74db-40d9-b098-5f415e643c39', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a5553a-3a51-493d-9443-1a9fcccd884a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a5553a-3a51-493d-9443-1a9fcccd884a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5ce6b5-bf39-4c97-92d8-eac8e1ebae55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:46 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume 0034ac80-74db-40d9-b098-5f415e643c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0034ac80-74db-40d9-b098-5f415e643c39', 'volume_size': 1}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2111549479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0034ac80-74db-40d9-b098-5f415e643c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e8f919bcbf41e59551e6c3479f064d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:47Z,use_quota=True,user_id='3064deeecd5649f4b363a38dfb2090d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Creating volume 0034ac80-74db-40d9-b098-5f415e643c39 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:46 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0034ac80-74db-40d9-b098-5f415e643c39 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:46 devstack sudo[100924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0034ac80-74db-40d9-b098-5f415e643c39 1073741824
Nov 03 17:04:46 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Acquiring lock "cinder-quobyte-809428a1-f3bd-4d44-a183-66db046a9cbd" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Lock "cinder-quobyte-809428a1-f3bd-4d44-a183-66db046a9cbd" acquired by "delete_volume" :: waited 0.046s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f733cf-0c33-4e27-a49a-b786d2ee12d5]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-809428a1-f3bd-4d44-a183-66db046a9cbd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:47 devstack sudo[100926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-809428a1-f3bd-4d44-a183-66db046a9cbd
Nov 03 17:04:47 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Flow 'volume_create_manager' (a33f2f57-53ca-4566-9a83-0804552c83e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d810414b-c929-460f-90c2-b649815a93dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d810414b-c929-460f-90c2-b649815a93dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1033781321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34da18ea-ccd1-4835-b882-5cb5cdc54e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e8f919bcbf41e59551e6c3479f064d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:47Z,use_quota=True,user_id='3064deeecd5649f4b363a38dfb2090d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ff222b-8ea0-4ceb-be5a-c93d940fcef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ff222b-8ea0-4ceb-be5a-c93d940fcef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246f0177-a104-4ca7-967c-c77f59f94ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246f0177-a104-4ca7-967c-c77f59f94ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34da18ea-ccd1-4835-b882-5cb5cdc54e9d', 'volume_name': 'volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fedbfad-76db-4694-975a-6b40f00e4c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fedbfad-76db-4694-975a-6b40f00e4c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe077dd-40d7-4268-976a-a8d642c9b19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:47 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume 34da18ea-ccd1-4835-b882-5cb5cdc54e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d', 'volume_size': 1}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:47 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0034ac80-74db-40d9-b098-5f415e643c39 1073741824" returned: 0 in 0.792s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:47 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-809428a1-f3bd-4d44-a183-66db046a9cbd" returned: 0 in 0.579s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-809428a1-f3bd-4d44-a183-66db046a9cbd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0034ac80-74db-40d9-b098-5f415e643c39 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:47 devstack sudo[100934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-809428a1-f3bd-4d44-a183-66db046a9cbd
Nov 03 17:04:47 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:47 devstack sudo[100935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0034ac80-74db-40d9-b098-5f415e643c39
Nov 03 17:04:47 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Flow 'volume_create_manager' (a55a17ab-0a55-4d22-9ab3-f8e408f7d54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:47 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a7bde6-65a4-4a59-8403-382d23436aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0034ac80-74db-40d9-b098-5f415e643c39" returned: 0 in 0.339s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.600s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1033781321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34da18ea-ccd1-4835-b882-5cb5cdc54e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e8f919bcbf41e59551e6c3479f064d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:47Z,use_quota=True,user_id='3064deeecd5649f4b363a38dfb2090d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Creating volume 34da18ea-ccd1-4835-b882-5cb5cdc54e9d {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:48 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:48 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:48 devstack sudo[100940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d 1073741824
Nov 03 17:04:48 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a7bde6-65a4-4a59-8403-382d23436aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-477507317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071961aa-672c-4b1a-a58a-0366c8a5ff4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e8f919bcbf41e59551e6c3479f064d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:48Z,use_quota=True,user_id='3064deeecd5649f4b363a38dfb2090d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd02ffc7-fc98-4378-a464-d260eed62baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd02ffc7-fc98-4378-a464-d260eed62baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5cbb406-e2bc-44cf-babe-06097baa6ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5cbb406-e2bc-44cf-babe-06097baa6ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '071961aa-672c-4b1a-a58a-0366c8a5ff4d', 'volume_name': 'volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9396dcfd-dcca-4a32-a2c6-d099ab50338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9396dcfd-dcca-4a32-a2c6-d099ab50338e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15149c9-fcb1-4e3a-b394-ea08c7cded8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:48 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume 071961aa-672c-4b1a-a58a-0366c8a5ff4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d', 'volume_size': 1}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-809428a1-f3bd-4d44-a183-66db046a9cbd" returned: 0 in 0.552s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5ce6b5-bf39-4c97-92d8-eac8e1ebae55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0034ac80-74db-40d9-b098-5f415e643c39', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191eb635-e7e0-4fae-8863-f3859810311e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Lock "cinder-quobyte-809428a1-f3bd-4d44-a183-66db046a9cbd" released by "delete_volume" :: held 1.279s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Acquiring lock "cinder-quobyte-8ba05fb6-0ecb-4143-a09a-3b564e6375ec" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:48 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume volume-0034ac80-74db-40d9-b098-5f415e643c39 (0034ac80-74db-40d9-b098-5f415e643c39): created successfully
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191eb635-e7e0-4fae-8863-f3859810311e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Flow 'volume_create_manager' (1eb653f0-3022-4d8c-8405-fe5ee08ddceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Lock "cinder-quobyte-8ba05fb6-0ecb-4143-a09a-3b564e6375ec" acquired by "delete_volume" :: waited 0.086s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-eb6cd20c-5b5c-44d8-b133-476ec654c7cd tempest-CreateVolumesFromSnapshotTest-1040080432 None] Created volume successfully.
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[526dba95-342c-49ea-8d99-ed712715f79e]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Flow 'volume_create_manager' (d03f3b90-02f8-4abf-90d0-45b220463c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a793fb8-e916-4afe-9fb6-bd4089ef5ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:48 devstack sudo[100944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec
Nov 03 17:04:48 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a793fb8-e916-4afe-9fb6-bd4089ef5ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052855885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39cc21b4-cd68-4810-97cb-4017fd44939d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e8f919bcbf41e59551e6c3479f064d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:49Z,use_quota=True,user_id='3064deeecd5649f4b363a38dfb2090d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5256d29c-76f2-4000-bdd8-5617495b2386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5256d29c-76f2-4000-bdd8-5617495b2386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93768fb-fe4b-4536-83df-339607c532ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93768fb-fe4b-4536-83df-339607c532ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39cc21b4-cd68-4810-97cb-4017fd44939d', 'volume_name': 'volume-39cc21b4-cd68-4810-97cb-4017fd44939d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:48 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7b91a6-e72d-475c-9293-40078782052d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7b91a6-e72d-475c-9293-40078782052d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1473d90-c6f3-47cd-8126-034aeacdcb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:48 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume 39cc21b4-cd68-4810-97cb-4017fd44939d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39cc21b4-cd68-4810-97cb-4017fd44939d', 'volume_size': 1}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d 1073741824" returned: 0 in 0.913s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:49 devstack sudo[100948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d
Nov 03 17:04:49 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:49 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec" returned: 0 in 0.931s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:49 devstack sudo[100953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec
Nov 03 17:04:49 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Flow 'volume_create_manager' (d6cc6a46-1492-4d47-aab4-ee30ec8d96ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:49 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71931f6-c150-4559-bbbd-334d70ef721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=200,cinder:UPDATE=229,cinder:INSERT=51,cinder:DELETE=19 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d" returned: 0 in 0.490s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.360s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-477507317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071961aa-672c-4b1a-a58a-0366c8a5ff4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e8f919bcbf41e59551e6c3479f064d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:48Z,use_quota=True,user_id='3064deeecd5649f4b363a38dfb2090d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Creating volume 071961aa-672c-4b1a-a58a-0366c8a5ff4d {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:49 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:49 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d 1073741824
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71931f6-c150-4559-bbbd-334d70ef721f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1021479374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31939111-3535-4d5a-babc-13bcdefa608e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e8f919bcbf41e59551e6c3479f064d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:49Z,use_quota=True,user_id='3064deeecd5649f4b363a38dfb2090d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:49 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df19f27f-9c8c-432d-903f-48b4c8937c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df19f27f-9c8c-432d-903f-48b4c8937c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95caf22d-f0f6-4012-ad8d-b70ed266fc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95caf22d-f0f6-4012-ad8d-b70ed266fc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31939111-3535-4d5a-babc-13bcdefa608e', 'volume_name': 'volume-31939111-3535-4d5a-babc-13bcdefa608e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a061525-f059-48cd-923f-0d5d0b2e9f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a061525-f059-48cd-923f-0d5d0b2e9f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8d6bbc-c0e0-4d77-8c7d-e26c4d045c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:49 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume 31939111-3535-4d5a-babc-13bcdefa608e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31939111-3535-4d5a-babc-13bcdefa608e', 'volume_size': 1}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe077dd-40d7-4268-976a-a8d642c9b19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3864b949-b04a-4feb-befa-9c983b85a003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:49 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-8ba05fb6-0ecb-4143-a09a-3b564e6375ec" returned: 0 in 0.347s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:49 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d (34da18ea-ccd1-4835-b882-5cb5cdc54e9d): created successfully
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3864b949-b04a-4feb-befa-9c983b85a003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Flow 'volume_create_manager' (a33f2f57-53ca-4566-9a83-0804552c83e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Lock "cinder-quobyte-8ba05fb6-0ecb-4143-a09a-3b564e6375ec" released by "delete_volume" :: held 1.411s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-06721f68-ad28-47c9-8366-890157af2ca2 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Created volume successfully.
Nov 03 17:04:49 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Created reservations ['943e42b7-e77f-4188-aad3-06cd9c22bcf0'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:50 devstack cinder-volume[87122]: WARNING cinder.quota [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1337839154 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1337839154, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:04:50 devstack cinder-volume[87122]: WARNING cinder.quota [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1337839154 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1337839154, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Created reservations ['f92b5165-ab3d-467e-a3fe-10c1cd877bc0', '8b73a0de-8251-4a03-a10f-16e514a11102', 'c650f477-86ec-4b92-b383-ed4cd337750c', '7abfab59-f511-4168-82de-e78940438068'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Created reservations ['4acfa060-1b82-4e77-ac74-78c74b6182d7', 'f8327fb0-6433-4f9a-bf52-e06ea1610055', '6edf28fc-3369-4aa4-b1c7-eed756a1ec83', '59b90946-3bb4-41e8-9a60-80f61a3ae62e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:50 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d 1073741824" returned: 0 in 0.846s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:50 devstack sudo[100964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:50 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:50 devstack sudo[100966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d
Nov 03 17:04:50 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:50 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d" returned: 0 in 0.316s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.806s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052855885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39cc21b4-cd68-4810-97cb-4017fd44939d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e8f919bcbf41e59551e6c3479f064d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:49Z,use_quota=True,user_id='3064deeecd5649f4b363a38dfb2090d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Creating volume 39cc21b4-cd68-4810-97cb-4017fd44939d {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:50 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:50 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-39cc21b4-cd68-4810-97cb-4017fd44939d 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.420s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:50 devstack sudo[100971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-39cc21b4-cd68-4810-97cb-4017fd44939d 1073741824
Nov 03 17:04:50 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15149c9-fcb1-4e3a-b394-ea08c7cded8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0c81f3-1bd9-4921-9471-9ab6c908e81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-08466c26-f778-4684-892c-369965204d61 tempest-GroupsTest-1827345132 None] Delete group completed successfully.
Nov 03 17:04:50 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d (071961aa-672c-4b1a-a58a-0366c8a5ff4d): created successfully
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0c81f3-1bd9-4921-9471-9ab6c908e81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Flow 'volume_create_manager' (a55a17ab-0a55-4d22-9ab3-f8e408f7d54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9eabc1f7-f071-41e3-8f06-513b33f544da tempest-CreateVolumesFromSnapshotTest-1040080432 None] Created volume successfully.
Nov 03 17:04:51 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-39cc21b4-cd68-4810-97cb-4017fd44939d 1073741824" returned: 0 in 0.601s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-39cc21b4-cd68-4810-97cb-4017fd44939d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:51 devstack sudo[100977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-39cc21b4-cd68-4810-97cb-4017fd44939d
Nov 03 17:04:51 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:51 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-39cc21b4-cd68-4810-97cb-4017fd44939d" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.159s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1021479374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31939111-3535-4d5a-babc-13bcdefa608e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e8f919bcbf41e59551e6c3479f064d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:49Z,use_quota=True,user_id='3064deeecd5649f4b363a38dfb2090d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Creating volume 31939111-3535-4d5a-babc-13bcdefa608e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:51 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31939111-3535-4d5a-babc-13bcdefa608e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:51 devstack sudo[100980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31939111-3535-4d5a-babc-13bcdefa608e 1073741824
Nov 03 17:04:51 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:51 devstack sudo[100982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:51 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1473d90-c6f3-47cd-8126-034aeacdcb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39cc21b4-cd68-4810-97cb-4017fd44939d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae5245d-d12e-472b-a4b8-ca62f8fc394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:51 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume volume-39cc21b4-cd68-4810-97cb-4017fd44939d (39cc21b4-cd68-4810-97cb-4017fd44939d): created successfully
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae5245d-d12e-472b-a4b8-ca62f8fc394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Flow 'volume_create_manager' (d03f3b90-02f8-4abf-90d0-45b220463c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-150e1dc5-b7cc-42d4-845c-b3281896054a tempest-CreateVolumesFromSnapshotTest-1040080432 None] Created volume successfully.
Nov 03 17:04:52 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.387s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 29 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>, <Thread(Rabbit-heartbeat, started daemon 139029247180864)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:04:52 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31939111-3535-4d5a-babc-13bcdefa608e 1073741824" returned: 0 in 0.738s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31939111-3535-4d5a-babc-13bcdefa608e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:52 devstack sudo[100990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31939111-3535-4d5a-babc-13bcdefa608e
Nov 03 17:04:52 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:52 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31939111-3535-4d5a-babc-13bcdefa608e" returned: 0 in 0.322s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8d6bbc-c0e0-4d77-8c7d-e26c4d045c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31939111-3535-4d5a-babc-13bcdefa608e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45893429-834b-4271-bfcd-eba0af13cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:52 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Volume volume-31939111-3535-4d5a-babc-13bcdefa608e (31939111-3535-4d5a-babc-13bcdefa608e): created successfully
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45893429-834b-4271-bfcd-eba0af13cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Flow 'volume_create_manager' (d6cc6a46-1492-4d47-aab4-ee30ec8d96ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-30040398-4e6d-40db-9f6c-d60ee99031b0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Created volume successfully.
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Flow 'volume_create_manager' (6ab81d77-7e95-4ed1-855d-2ff20bf0ba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91985c4f-463d-408d-9504-d5c1bc0b45a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91985c4f-463d-408d-9504-d5c1bc0b45a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874305414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b882848b-0466-4535-a424-ee76d9e2812e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d7bcc39ad2407fb6dae729b0bd6259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:54Z,use_quota=True,user_id='4725b73af6404f2c8f1ceb07c73815c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ace3d2a-21a8-4bd6-8843-274045238c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ace3d2a-21a8-4bd6-8843-274045238c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb67325-a20d-4351-b792-ed6e27f09220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb67325-a20d-4351-b792-ed6e27f09220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b882848b-0466-4535-a424-ee76d9e2812e', 'volume_name': 'volume-b882848b-0466-4535-a424-ee76d9e2812e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d130ebef-ec83-42d9-8d77-1412ad03f9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d130ebef-ec83-42d9-8d77-1412ad03f9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82795a6-a1cc-415d-ace1-a5f83b5cdff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:53 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Volume b882848b-0466-4535-a424-ee76d9e2812e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b882848b-0466-4535-a424-ee76d9e2812e', 'volume_size': 1}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874305414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b882848b-0466-4535-a424-ee76d9e2812e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d7bcc39ad2407fb6dae729b0bd6259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:54Z,use_quota=True,user_id='4725b73af6404f2c8f1ceb07c73815c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Creating volume b882848b-0466-4535-a424-ee76d9e2812e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:53 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b882848b-0466-4535-a424-ee76d9e2812e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:53 devstack sudo[100993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b882848b-0466-4535-a424-ee76d9e2812e 1073741824
Nov 03 17:04:53 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-31939111-3535-4d5a-babc-13bcdefa608e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-31939111-3535-4d5a-babc-13bcdefa608e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-quobyte-31939111-3535-4d5a-babc-13bcdefa608e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-31939111-3535-4d5a-babc-13bcdefa608e" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fd5900-687d-4ac4-8c33-1bbcf3d098c8]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31939111-3535-4d5a-babc-13bcdefa608e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:54 devstack sudo[100998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31939111-3535-4d5a-babc-13bcdefa608e
Nov 03 17:04:54 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:54 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b882848b-0466-4535-a424-ee76d9e2812e 1073741824" returned: 0 in 0.667s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b882848b-0466-4535-a424-ee76d9e2812e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:54 devstack sudo[101001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b882848b-0466-4535-a424-ee76d9e2812e
Nov 03 17:04:54 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:54 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31939111-3535-4d5a-babc-13bcdefa608e" returned: 0 in 0.543s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31939111-3535-4d5a-babc-13bcdefa608e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:54 devstack sudo[101007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31939111-3535-4d5a-babc-13bcdefa608e
Nov 03 17:04:54 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:54 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b882848b-0466-4535-a424-ee76d9e2812e" returned: 0 in 0.321s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82795a6-a1cc-415d-ace1-a5f83b5cdff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b882848b-0466-4535-a424-ee76d9e2812e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b96e22c-d6a0-4fb7-81fe-b5a7ca53c89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Volume volume-b882848b-0466-4535-a424-ee76d9e2812e (b882848b-0466-4535-a424-ee76d9e2812e): created successfully
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b96e22c-d6a0-4fb7-81fe-b5a7ca53c89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Flow 'volume_create_manager' (6ab81d77-7e95-4ed1-855d-2ff20bf0ba46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8455ab4d-407e-4fdc-ba50-454c520bb337 tempest-ProjectReaderTests-2068304457 None] Created volume successfully.
Nov 03 17:04:55 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-31939111-3535-4d5a-babc-13bcdefa608e" returned: 0 in 0.357s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-31939111-3535-4d5a-babc-13bcdefa608e" released by "delete_volume" :: held 0.970s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:55 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Created reservations ['3475522c-11f4-4590-b5c0-92da4b49f589', 'd259814f-926f-4eda-84e0-6e5080b48ae8', 'd77247f9-ea20-417a-8675-16b2de3a0eba', 'b143ef37-e254-4da1-9309-bff3b5b59f75'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:55 devstack sudo[101010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:55 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:55 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.316s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:55 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Deleted volume successfully.
Nov 03 17:04:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-93066e74-9bde-43c4-bfa3-7716257b7262 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-31939111-3535-4d5a-babc-13bcdefa608e-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "cinder-b882848b-0466-4535-a424-ee76d9e2812e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Lock "cinder-b882848b-0466-4535-a424-ee76d9e2812e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "cinder-quobyte-b882848b-0466-4535-a424-ee76d9e2812e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Lock "cinder-quobyte-b882848b-0466-4535-a424-ee76d9e2812e" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[661de3dc-21aa-4500-ace3-127905420cde]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b882848b-0466-4535-a424-ee76d9e2812e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-39cc21b4-cd68-4810-97cb-4017fd44939d-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-39cc21b4-cd68-4810-97cb-4017fd44939d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:56 devstack sudo[101015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b882848b-0466-4535-a424-ee76d9e2812e
Nov 03 17:04:56 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-quobyte-39cc21b4-cd68-4810-97cb-4017fd44939d" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-39cc21b4-cd68-4810-97cb-4017fd44939d" acquired by "delete_volume" :: waited 0.033s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d45823e-69d9-4373-b82b-a2c7b54fb31c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-39cc21b4-cd68-4810-97cb-4017fd44939d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:56 devstack sudo[101017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-39cc21b4-cd68-4810-97cb-4017fd44939d
Nov 03 17:04:56 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:56 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b882848b-0466-4535-a424-ee76d9e2812e" returned: 0 in 0.514s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b882848b-0466-4535-a424-ee76d9e2812e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:56 devstack sudo[101022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b882848b-0466-4535-a424-ee76d9e2812e
Nov 03 17:04:56 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:57 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-39cc21b4-cd68-4810-97cb-4017fd44939d" returned: 0 in 0.454s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-39cc21b4-cd68-4810-97cb-4017fd44939d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:57 devstack sudo[101028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-39cc21b4-cd68-4810-97cb-4017fd44939d
Nov 03 17:04:57 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:57 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b882848b-0466-4535-a424-ee76d9e2812e" returned: 0 in 0.333s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Lock "cinder-quobyte-b882848b-0466-4535-a424-ee76d9e2812e" released by "delete_volume" :: held 0.931s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Created reservations ['765b8f83-7f95-4269-962b-4a89b23a1cbd', '3bf6a585-4589-4904-8926-f4aa2c6e51d1', 'be791781-6143-4afb-84d9-5c3d46a28ded', '8eab3915-ace6-4b86-80ef-70c6bc29a50f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:57 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-39cc21b4-cd68-4810-97cb-4017fd44939d" returned: 0 in 0.360s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-39cc21b4-cd68-4810-97cb-4017fd44939d" released by "delete_volume" :: held 0.896s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:57 devstack sudo[101032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:57 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Created reservations ['2cbc26ef-5a02-4bf8-9bd2-c13d43d48c5b', 'e88128e7-2ab5-4180-b9d6-783812e12e2c', 'acb55e47-3e47-4ed6-bc63-12f20a02bdf3', 'f9fbe386-af43-4e7a-9513-c358cc72b8c5'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:57 devstack sudo[101034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:04:57 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:58 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.509s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Deleted volume successfully.
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7196a148-ca28-49a6-81f9-2349cd4a14c1 tempest-ProjectReaderTests-2068304457 None] Lock "cinder-b882848b-0466-4535-a424-ee76d9e2812e-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:58 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.451s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:04:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Deleted volume successfully.
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4584e584-2d40-49a2-ab1e-719067d704d8 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-39cc21b4-cd68-4810-97cb-4017fd44939d-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Flow 'volume_create_manager' (8b596ddf-24eb-488e-a6ad-90cbea487361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c61bd1-a7cd-4db6-a501-ef863ef24e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c61bd1-a7cd-4db6-a501-ef863ef24e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-552911513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087355df-5b6c-457f-ac45-f523a6977bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d7bcc39ad2407fb6dae729b0bd6259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:58Z,use_quota=True,user_id='4725b73af6404f2c8f1ceb07c73815c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e411c646-7400-41eb-bfe9-5f16fcacb576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e411c646-7400-41eb-bfe9-5f16fcacb576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfb565f-4e01-4359-bb8b-9cc865300d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfb565f-4e01-4359-bb8b-9cc865300d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '087355df-5b6c-457f-ac45-f523a6977bd3', 'volume_name': 'volume-087355df-5b6c-457f-ac45-f523a6977bd3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc90a277-b2a1-47c3-aafc-0712596bb67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc90a277-b2a1-47c3-aafc-0712596bb67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680601d9-c2a9-404b-b9d7-00c624f503f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Volume 087355df-5b6c-457f-ac45-f523a6977bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-087355df-5b6c-457f-ac45-f523a6977bd3', 'volume_size': 1}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-552911513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087355df-5b6c-457f-ac45-f523a6977bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d7bcc39ad2407fb6dae729b0bd6259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:58Z,use_quota=True,user_id='4725b73af6404f2c8f1ceb07c73815c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Creating volume 087355df-5b6c-457f-ac45-f523a6977bd3 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:04:58 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:04:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-087355df-5b6c-457f-ac45-f523a6977bd3 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:58 devstack sudo[101038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-087355df-5b6c-457f-ac45-f523a6977bd3 1073741824
Nov 03 17:04:58 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-071961aa-672c-4b1a-a58a-0366c8a5ff4d-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-071961aa-672c-4b1a-a58a-0366c8a5ff4d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:59 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-087355df-5b6c-457f-ac45-f523a6977bd3 1073741824" returned: 0 in 0.628s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-quobyte-071961aa-672c-4b1a-a58a-0366c8a5ff4d" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-087355df-5b6c-457f-ac45-f523a6977bd3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-071961aa-672c-4b1a-a58a-0366c8a5ff4d" acquired by "delete_volume" :: waited 0.046s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:04:59 devstack sudo[101044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-087355df-5b6c-457f-ac45-f523a6977bd3
Nov 03 17:04:59 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44f364a-c0e2-4f3d-bb27-7ab6641ad18c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:59 devstack sudo[101046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d
Nov 03 17:04:59 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:04:59 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-087355df-5b6c-457f-ac45-f523a6977bd3" returned: 0 in 0.334s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680601d9-c2a9-404b-b9d7-00c624f503f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087355df-5b6c-457f-ac45-f523a6977bd3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f73d19-514e-43c6-814f-94446071a2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:04:59 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Volume volume-087355df-5b6c-457f-ac45-f523a6977bd3 (087355df-5b6c-457f-ac45-f523a6977bd3): created successfully
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f73d19-514e-43c6-814f-94446071a2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Flow 'volume_create_manager' (8b596ddf-24eb-488e-a6ad-90cbea487361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:04:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-92fc0128-b7f3-4299-9eda-26da5b8aef95 tempest-ProjectReaderTests-2068304457 None] Created volume successfully.
Nov 03 17:04:59 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d" returned: 0 in 0.595s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:04:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:04:59 devstack sudo[101053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d
Nov 03 17:04:59 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:00 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-071961aa-672c-4b1a-a58a-0366c8a5ff4d" returned: 0 in 0.281s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-071961aa-672c-4b1a-a58a-0366c8a5ff4d" released by "delete_volume" :: held 0.961s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Created reservations ['16a37e28-cb07-46d3-8325-1f53e668ac04', '16033be4-daf6-4e98-b5db-d285d38ca3fb', '809d5a96-40c6-432c-8c6d-434234f72635', 'cdabf115-50c3-4301-a0b3-cf5ae5aac5ff'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:00 devstack sudo[101056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:00 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "cinder-087355df-5b6c-457f-ac45-f523a6977bd3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Lock "cinder-087355df-5b6c-457f-ac45-f523a6977bd3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "cinder-quobyte-087355df-5b6c-457f-ac45-f523a6977bd3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Lock "cinder-quobyte-087355df-5b6c-457f-ac45-f523a6977bd3" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e5452d-a5d6-4c91-ae2a-c642f0ed889d]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-087355df-5b6c-457f-ac45-f523a6977bd3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:00 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.339s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:00 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Deleted volume successfully.
Nov 03 17:05:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d1f7b92f-d992-4db4-8778-731a82436f0f tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-071961aa-672c-4b1a-a58a-0366c8a5ff4d-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:00 devstack sudo[101060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-087355df-5b6c-457f-ac45-f523a6977bd3
Nov 03 17:05:00 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:01 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-087355df-5b6c-457f-ac45-f523a6977bd3" returned: 0 in 0.432s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-087355df-5b6c-457f-ac45-f523a6977bd3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:01 devstack sudo[101066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-087355df-5b6c-457f-ac45-f523a6977bd3
Nov 03 17:05:01 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:01 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-087355df-5b6c-457f-ac45-f523a6977bd3" returned: 0 in 0.301s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-34da18ea-ccd1-4835-b882-5cb5cdc54e9d-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Lock "cinder-quobyte-087355df-5b6c-457f-ac45-f523a6977bd3" released by "delete_volume" :: held 0.825s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-34da18ea-ccd1-4835-b882-5cb5cdc54e9d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-quobyte-34da18ea-ccd1-4835-b882-5cb5cdc54e9d" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-34da18ea-ccd1-4835-b882-5cb5cdc54e9d" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Created reservations ['28335b55-ca8e-4ddb-bf8c-5b2a9e67e42b', '27fa4293-c9a6-4a62-a6f6-9bf370986625', '113bd754-6417-42fe-93e1-8b73f426cb0f', '0b067ca6-ce1e-4638-945d-0cf15fff7bc5'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb0fa91-00ea-4b52-9f66-18fa13c1e3ad]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:01 devstack sudo[101073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:01 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:01 devstack sudo[101072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d
Nov 03 17:05:01 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:02 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.304s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Deleted volume successfully.
Nov 03 17:05:02 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae238686-59c8-4bd2-b68f-e5cef2fdc2c8 tempest-ProjectReaderTests-2068304457 None] Lock "cinder-087355df-5b6c-457f-ac45-f523a6977bd3-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d" returned: 0 in 0.582s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:02 devstack sudo[101082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d
Nov 03 17:05:02 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:02 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-34da18ea-ccd1-4835-b882-5cb5cdc54e9d" returned: 0 in 0.331s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-34da18ea-ccd1-4835-b882-5cb5cdc54e9d" released by "delete_volume" :: held 0.997s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Created reservations ['ee3ea6d0-7ee7-4e22-b61f-71bd77e12806', '22f4bfca-fdb0-46c5-85af-e2aa936462c3', '8f648178-fe04-4bdd-a83f-51529bb20f0f', '97f435e5-14ea-477c-a681-52d32eb3306e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:02 devstack sudo[101085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:02 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Flow 'volume_create_manager' (477c65e2-c5b9-43e4-8b76-647dac1a793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a900b25-77e1-4a39-8fc4-78623e93f527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a900b25-77e1-4a39-8fc4-78623e93f527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-956463959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c30aff-eda2-4307-a60c-ecce28599eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e64ff6cca44c1686d4780e1c64d80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:03Z,use_quota=True,user_id='b887643d12514860a27b084fba589e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935c0845-7d31-40f9-a2d2-2347634bed3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935c0845-7d31-40f9-a2d2-2347634bed3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d513ac7e-fa21-437f-8593-11248b173cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:02 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 17:05:03 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.306s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Deleted volume successfully.
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2f53572c-56e4-40f4-ab15-343d20b812f0 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-34da18ea-ccd1-4835-b882-5cb5cdc54e9d-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d513ac7e-fa21-437f-8593-11248b173cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '04c30aff-eda2-4307-a60c-ecce28599eba', 'volume_name': 'volume-04c30aff-eda2-4307-a60c-ecce28599eba', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e723a84c3b0>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8288844e-1df4-4c94-b261-6303bdb89ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8288844e-1df4-4c94-b261-6303bdb89ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f2a06b-2b26-4b25-a063-afa3a4606f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:03 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Volume 04c30aff-eda2-4307-a60c-ecce28599eba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-04c30aff-eda2-4307-a60c-ecce28599eba', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e723a84c3b0>}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Trying to clone 04c30aff-eda2-4307-a60c-ecce28599eba from image 12ab4fb0-81c3-4967-9eea-39afb443d41b at location (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Flow 'volume_create_manager' (ed5e4cb3-2ef6-43dd-ad10-19e83a73dd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00153d06-08cd-4a7c-bcf3-d171f62d2e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00153d06-08cd-4a7c-bcf3-d171f62d2e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1301366874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ad2d21-b1a2-47d9-ae24-db53f4f14c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d7bcc39ad2407fb6dae729b0bd6259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:03Z,use_quota=True,user_id='4725b73af6404f2c8f1ceb07c73815c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1cf28b-3445-45e2-bfff-71bcdc4d82e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1cf28b-3445-45e2-bfff-71bcdc4d82e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c57a26c-ca57-42a4-93c7-6cedde19d569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c57a26c-ca57-42a4-93c7-6cedde19d569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25ad2d21-b1a2-47d9-ae24-db53f4f14c75', 'volume_name': 'volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70d4a08-492b-47bd-bd80-f477bcf182e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70d4a08-492b-47bd-bd80-f477bcf182e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a7186d-7ab5-4f59-9fd8-3b9f014ccaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:03 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Volume 25ad2d21-b1a2-47d9-ae24-db53f4f14c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75', 'volume_size': 1}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1301366874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ad2d21-b1a2-47d9-ae24-db53f4f14c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d7bcc39ad2407fb6dae729b0bd6259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:03Z,use_quota=True,user_id='4725b73af6404f2c8f1ceb07c73815c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Creating volume 25ad2d21-b1a2-47d9-ae24-db53f4f14c75 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:03 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:03 devstack sudo[101088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75 1073741824
Nov 03 17:05:03 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-0034ac80-74db-40d9-b098-5f415e643c39-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-0034ac80-74db-40d9-b098-5f415e643c39-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 17:05:03 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-quobyte-0034ac80-74db-40d9-b098-5f415e643c39" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-0034ac80-74db-40d9-b098-5f415e643c39" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adc9307-b419-4f4c-97b8-281698b01a28]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efe2323-7649-4c1d-bcdd-6546d742acdc]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0034ac80-74db-40d9-b098-5f415e643c39 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:04 devstack sudo[101094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD
Nov 03 17:05:04 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:04 devstack sudo[101096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0034ac80-74db-40d9-b098-5f415e643c39
Nov 03 17:05:04 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:04 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75 1073741824" returned: 0 in 0.692s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:04 devstack sudo[101099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75
Nov 03 17:05:04 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:04 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Temporary image 12ab4fb0-81c3-4967-9eea-39afb443d41b is fetched for user b887643d12514860a27b084fba589e28. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5406ed-6c65-4c28-9e51-066bb1dd7895]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:04 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0034ac80-74db-40d9-b098-5f415e643c39" returned: 0 in 0.543s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0034ac80-74db-40d9-b098-5f415e643c39 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:04 devstack sudo[101110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0034ac80-74db-40d9-b098-5f415e643c39
Nov 03 17:05:04 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:04 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75" returned: 0 in 0.383s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a7186d-7ab5-4f59-9fd8-3b9f014ccaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78433cfc-a76e-4154-ad27-2f337f560ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:04 devstack sudo[101108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD
Nov 03 17:05:04 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:04 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Volume volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75 (25ad2d21-b1a2-47d9-ae24-db53f4f14c75): created successfully
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78433cfc-a76e-4154-ad27-2f337f560ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Flow 'volume_create_manager' (ed5e4cb3-2ef6-43dd-ad10-19e83a73dd89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bea348d6-ea45-43b6-a895-34044e91c454 tempest-ProjectReaderTests-2068304457 None] Created volume successfully.
Nov 03 17:05:04 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0034ac80-74db-40d9-b098-5f415e643c39" returned: 0 in 0.356s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-0034ac80-74db-40d9-b098-5f415e643c39" released by "delete_volume" :: held 0.972s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:05 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD" returned: 0 in 0.532s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-956463959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c30aff-eda2-4307-a60c-ecce28599eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e64ff6cca44c1686d4780e1c64d80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:03Z,use_quota=True,user_id='b887643d12514860a27b084fba589e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Creating volume 04c30aff-eda2-4307-a60c-ecce28599eba {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:05 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Created reservations ['6477fe52-e7d9-438e-8f13-1dab833fcce3', '74d374d3-3cc1-44f2-bb65-83cf016db924', 'f89503f9-8521-4de2-8c09-ca79de7c6483', '48378d6a-1de5-4088-b5d1-8458ea523607'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:05 devstack sudo[101118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba 1073741824
Nov 03 17:05:05 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:05 devstack sudo[101120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:05 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:05 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.292s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Deleted volume successfully.
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66522f02-2a1e-443f-bdab-62fbb60045ae tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-0034ac80-74db-40d9-b098-5f415e643c39-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "cinder-25ad2d21-b1a2-47d9-ae24-db53f4f14c75-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Lock "cinder-25ad2d21-b1a2-47d9-ae24-db53f4f14c75-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:05 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba 1073741824" returned: 0 in 0.591s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "cinder-quobyte-25ad2d21-b1a2-47d9-ae24-db53f4f14c75" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Lock "cinder-quobyte-25ad2d21-b1a2-47d9-ae24-db53f4f14c75" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:05 devstack sudo[101126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba
Nov 03 17:05:05 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[707b1f04-da1f-42f2-8080-62f03bfe7823]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:05 devstack sudo[101128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75
Nov 03 17:05:05 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:05 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba" returned: 0 in 0.288s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Attempting download of 12ab4fb0-81c3-4967-9eea-39afb443d41b ((None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}])) to volume 04c30aff-eda2-4307-a60c-ecce28599eba. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2a7420-534f-44f7-a63b-258dc5e0f761]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_15oitzga {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-3607c3a7-b607-468e-8629-c914fd582d13-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-3607c3a7-b607-468e-8629-c914fd582d13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-quobyte-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-quobyte-3607c3a7-b607-468e-8629-c914fd582d13" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-3607c3a7-b607-468e-8629-c914fd582d13" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Deleting offline snapshot 3607c3a7-b607-468e-8629-c914fd582d13 of volume bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] snapshot_file for this snap is: volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:05:06 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75" returned: 0 in 0.476s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b74381-7e72-4aaf-8332-558d97584d4d]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:06 devstack sudo[101132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_15oitzga
Nov 03 17:05:06 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:06 devstack sudo[101135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75
Nov 03 17:05:06 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:06 devstack sudo[101136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13
Nov 03 17:05:06 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:06 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_15oitzga" returned: 0 in 0.411s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_15oitzga {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:06 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-25ad2d21-b1a2-47d9-ae24-db53f4f14c75" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Lock "cinder-quobyte-25ad2d21-b1a2-47d9-ae24-db53f4f14c75" released by "delete_volume" :: held 0.841s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Created reservations ['79950e83-dfdc-43bc-b65a-759bbd5f6636', '2c9fa0a6-79c7-4a58-a42b-836457a79130', '84b6ece9-a8bf-4271-9db9-6068a3be3fc6', 'efa27796-fe66-4d1b-b98f-3fddcf0b5f1b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:06 devstack sudo[101143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_15oitzga
Nov 03 17:05:06 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:06 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13" returned: 0 in 0.415s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7ae836-f1dc-4b31-9b76-01bd41b07fce]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:06 devstack sudo[101150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:06 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:06 devstack sudo[101149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7
Nov 03 17:05:06 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:07 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_15oitzga" returned: 1 in 0.575s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12ab4fb0-81c3-4967-9eea-39afb443d41b_15oitzga' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58b7931-b449-4a6a-ac37-a59e4c59ffe0]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:07 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.320s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Deleted volume successfully.
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6ca2ef7f-ed90-4824-aadb-6bddf8f0a7b8 tempest-ProjectReaderTests-2068304457 None] Lock "cinder-25ad2d21-b1a2-47d9-ae24-db53f4f14c75-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:07 devstack sudo[101156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD
Nov 03 17:05:07 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:07 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7" returned: 0 in 0.685s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:07 devstack sudo[101162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13
Nov 03 17:05:07 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:07 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] 12ab4fb0-81c3-4967-9eea-39afb443d41b was qcow2, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:07 devstack sudo[101168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba
Nov 03 17:05:07 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Flow 'volume_create_manager' (e666ab64-7f72-4323-8a4d-7e3143ebbdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b05fe44-fac5-45a1-a73b-ee20b95f3e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b05fe44-fac5-45a1-a73b-ee20b95f3e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1348957870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a053632-71bd-4a12-8405-6cb5bc544ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d7bcc39ad2407fb6dae729b0bd6259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:08Z,use_quota=True,user_id='4725b73af6404f2c8f1ceb07c73815c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e3a91b-0698-49e7-bd0e-ecdc61cc8163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e3a91b-0698-49e7-bd0e-ecdc61cc8163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb63904-7744-44c2-bab9-0175df355a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb63904-7744-44c2-bab9-0175df355a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a053632-71bd-4a12-8405-6cb5bc544ee0', 'volume_name': 'volume-9a053632-71bd-4a12-8405-6cb5bc544ee0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc901054-6512-4cd8-a545-cf5d6d74169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc901054-6512-4cd8-a545-cf5d6d74169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e328faf8-4ea7-464d-b649-acba23822ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:07 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Volume 9a053632-71bd-4a12-8405-6cb5bc544ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a053632-71bd-4a12-8405-6cb5bc544ee0', 'volume_size': 1}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1348957870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a053632-71bd-4a12-8405-6cb5bc544ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d7bcc39ad2407fb6dae729b0bd6259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:08Z,use_quota=True,user_id='4725b73af6404f2c8f1ceb07c73815c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Creating volume 9a053632-71bd-4a12-8405-6cb5bc544ee0 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:07 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9a053632-71bd-4a12-8405-6cb5bc544ee0 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:07 devstack sudo[101172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9a053632-71bd-4a12-8405-6cb5bc544ee0 1073741824
Nov 03 17:05:07 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:07 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13" returned: 0 in 0.398s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:07 devstack sudo[101179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13
Nov 03 17:05:07 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:08 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7.3607c3a7-b607-468e-8629-c914fd582d13" returned: 0 in 0.336s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:08 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9a053632-71bd-4a12-8405-6cb5bc544ee0 1073741824" returned: 0 in 0.538s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-3607c3a7-b607-468e-8629-c914fd582d13" released by "_delete_snapshot" :: held 2.009s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7" released by "delete_snapshot" :: held 2.043s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9a053632-71bd-4a12-8405-6cb5bc544ee0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:08 devstack sudo[101194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9a053632-71bd-4a12-8405-6cb5bc544ee0
Nov 03 17:05:08 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Created reservations ['bb248fd7-a840-4239-93f9-de515c3ce2fe', '83f193a6-7bf0-423c-8978-0796ccd8e125', '3d2130f9-c717-4600-87de-78cc192f3035', 'e4033b70-a3be-4cd8-9053-1a36be3dae78'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Delete snapshot completed successfully.
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-74a432e1-24a5-445b-8495-c86b35d731b7 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-3607c3a7-b607-468e-8629-c914fd582d13-delete_snapshot" released by "delete_snapshot" :: held 2.245s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:08 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9a053632-71bd-4a12-8405-6cb5bc544ee0" returned: 0 in 0.346s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e328faf8-4ea7-464d-b649-acba23822ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a053632-71bd-4a12-8405-6cb5bc544ee0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0853b4a-984c-456f-a955-e7a537d6e783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:08 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Volume volume-9a053632-71bd-4a12-8405-6cb5bc544ee0 (9a053632-71bd-4a12-8405-6cb5bc544ee0): created successfully
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0853b4a-984c-456f-a955-e7a537d6e783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Flow 'volume_create_manager' (e666ab64-7f72-4323-8a4d-7e3143ebbdcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f5634479-8907-4a81-9df1-169472c24a3d tempest-ProjectReaderTests-2068304457 None] Created volume successfully.
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "cinder-quobyte-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[190483fe-a139-47ad-86df-79db8c69961a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Acquiring lock "cinder-9a053632-71bd-4a12-8405-6cb5bc544ee0-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Lock "cinder-9a053632-71bd-4a12-8405-6cb5bc544ee0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:09 devstack sudo[101197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7
Nov 03 17:05:09 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Acquiring lock "cinder-quobyte-9a053632-71bd-4a12-8405-6cb5bc544ee0" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Lock "cinder-quobyte-9a053632-71bd-4a12-8405-6cb5bc544ee0" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Flow 'volume_create_manager' (5341f811-78de-432e-8130-caeb5dd98491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791504d6-a39c-46d6-a57f-10c68bc3b760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fd02bc-0f0a-408a-97ca-fe0a2bf09979]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9a053632-71bd-4a12-8405-6cb5bc544ee0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791504d6-a39c-46d6-a57f-10c68bc3b760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-533342001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67c5072-da8b-4e24-8fbc-bd29281c507b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74968f419d943f9976e8835c18b55e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:10Z,use_quota=True,user_id='449eaf280f8849da86597c4776f36066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e578f70-e828-4d64-ab32-256523961153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e578f70-e828-4d64-ab32-256523961153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05848c01-7825-4fe9-9fbf-946cfa899ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05848c01-7825-4fe9-9fbf-946cfa899ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67c5072-da8b-4e24-8fbc-bd29281c507b', 'volume_name': 'volume-c67c5072-da8b-4e24-8fbc-bd29281c507b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:09 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabcf034-d8e2-4f08-a6cc-1e1c7df576cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabcf034-d8e2-4f08-a6cc-1e1c7df576cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f2be2b-1f77-4c30-9acf-a998bfd2ff21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:09 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Volume c67c5072-da8b-4e24-8fbc-bd29281c507b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67c5072-da8b-4e24-8fbc-bd29281c507b', 'volume_size': 1}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-533342001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67c5072-da8b-4e24-8fbc-bd29281c507b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74968f419d943f9976e8835c18b55e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:10Z,use_quota=True,user_id='449eaf280f8849da86597c4776f36066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Creating volume c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:09 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba" returned: 0 in 2.425s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_12ab4fb0-81c3-4967-9eea-39afb443d41b_dq0l9r2zdevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:05:09 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Converted 112.00 MB image at 46.15 MB/s
Nov 03 17:05:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:10 devstack sudo[101206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b 1073741824
Nov 03 17:05:10 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:10 devstack sudo[101207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba 1G
Nov 03 17:05:10 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:10 devstack sudo[101205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9a053632-71bd-4a12-8405-6cb5bc544ee0
Nov 03 17:05:10 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:10 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7" returned: 0 in 0.561s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:10 devstack sudo[101215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7
Nov 03 17:05:10 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:10 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9a053632-71bd-4a12-8405-6cb5bc544ee0" returned: 0 in 0.439s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9a053632-71bd-4a12-8405-6cb5bc544ee0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:10 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba 1G" returned: 0 in 0.361s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Downloaded image 12ab4fb0-81c3-4967-9eea-39afb443d41b ((None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}])) to volume 04c30aff-eda2-4307-a60c-ecce28599eba successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Temporary image 12ab4fb0-81c3-4967-9eea-39afb443d41b for user b887643d12514860a27b084fba589e28 is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Marking volume 04c30aff-eda2-4307-a60c-ecce28599eba as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 17:05:10 devstack sudo[101227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9a053632-71bd-4a12-8405-6cb5bc544ee0
Nov 03 17:05:10 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Copying metadata from image 12ab4fb0-81c3-4967-9eea-39afb443d41b to 04c30aff-eda2-4307-a60c-ecce28599eba. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Creating volume glance metadata for volume 04c30aff-eda2-4307-a60c-ecce28599eba backed by image 12ab4fb0-81c3-4967-9eea-39afb443d41b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 17:05:10 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7" returned: 0 in 0.310s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-quobyte-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7" released by "delete_volume" :: held 0.984s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:10 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b 1073741824" returned: 0 in 0.523s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f2a06b-2b26-4b25-a063-afa3a4606f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c30aff-eda2-4307-a60c-ecce28599eba', 'volume_size': 1, 'image_id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12ab4fb0-81c3-4967-9eea-39afb443d41b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b13878e3a4a146f0adb2478a9304f0c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12ab4fb0-81c3-4967-9eea-39afb443d41b', 'created_at': datetime.datetime(2026, 11, 3, 15, 47, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 47, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12ab4fb0-81c3-4967-9eea-39afb443d41b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e723a84c3b0>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b067f5-7188-4867-b599-4f444a3536b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:10 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Volume volume-04c30aff-eda2-4307-a60c-ecce28599eba (04c30aff-eda2-4307-a60c-ecce28599eba): created successfully
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b067f5-7188-4867-b599-4f444a3536b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Flow 'volume_create_manager' (477c65e2-c5b9-43e4-8b76-647dac1a793f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:10 devstack sudo[101231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b
Nov 03 17:05:10 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Created reservations ['ce139e43-ab9a-4044-a3a7-d03712322f15', '78f15c07-eb95-4dc5-9f19-3e394e1e7d85', '622e4365-d8d7-49c4-937d-fa2fa8b091bd', 'd7dc385a-fea2-4c58-9b95-1913a8767f11'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:10 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-be7875e3-9ce9-49b5-8332-c0a1dd89c7a3 tempest-VolumesImageMetadata-975666 None] Created volume successfully.
Nov 03 17:05:10 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9a053632-71bd-4a12-8405-6cb5bc544ee0" returned: 0 in 0.320s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Lock "cinder-quobyte-9a053632-71bd-4a12-8405-6cb5bc544ee0" released by "delete_volume" :: held 0.872s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:10 devstack sudo[101234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:10 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Created reservations ['ddd1454a-7eaf-408b-b83e-c2af8649046e', '761fe5ec-c425-469b-b1db-30fecdb9e24c', '0dbd2a7e-4153-4108-9102-14d64c0dbed6', '2f35b5dd-7115-47dd-9da9-8ae0dd06ac97'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:10 devstack sudo[101237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:10 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:10 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f2be2b-1f77-4c30-9acf-a998bfd2ff21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67c5072-da8b-4e24-8fbc-bd29281c507b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1c8e92-8883-4d47-967d-6304e7370679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:10 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Volume volume-c67c5072-da8b-4e24-8fbc-bd29281c507b (c67c5072-da8b-4e24-8fbc-bd29281c507b): created successfully
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1c8e92-8883-4d47-967d-6304e7370679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Flow 'volume_create_manager' (5341f811-78de-432e-8130-caeb5dd98491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-450c7514-a791-40d9-9247-05a50ff59075 tempest-SnapshotsActionsTest-1502555873 None] Created volume successfully.
Nov 03 17:05:11 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.305s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:11 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Deleted volume successfully.
Nov 03 17:05:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-768b8e2a-6650-4246-bacf-4ffd8e801678 tempest-CreateVolumesFromSnapshotTest-1040080432 None] Lock "cinder-bc55bbf7-7533-4c74-ac02-c55ee8dcc1b7-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:11 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:11 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Deleted volume successfully.
Nov 03 17:05:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e7fc2483-0800-4d4f-aa26-4bdf2ea0334f tempest-ProjectReaderTests-2068304457 None] Lock "cinder-9a053632-71bd-4a12-8405-6cb5bc544ee0-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] Creating offline snapshot 9fa0070a-3cd7-45d3-9277-ef6fcd35a024 of volume c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Acquiring lock "cinder-04c30aff-eda2-4307-a60c-ecce28599eba-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26d578c-1e97-4eb1-b354-2e896b61ca19]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Lock "cinder-04c30aff-eda2-4307-a60c-ecce28599eba-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Acquiring lock "cinder-quobyte-04c30aff-eda2-4307-a60c-ecce28599eba" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Lock "cinder-quobyte-04c30aff-eda2-4307-a60c-ecce28599eba" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a523db6b-8ef8-41f8-a3f0-7a1b000d4c10]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:12 devstack sudo[101241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:12 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:12 devstack sudo[101243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba
Nov 03 17:05:12 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:12 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba" returned: 0 in 0.446s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:12 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b" returned: 0 in 0.615s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:12 devstack sudo[101252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba
Nov 03 17:05:12 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:12 devstack sudo[101253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 1G
Nov 03 17:05:12 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:13 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04c30aff-eda2-4307-a60c-ecce28599eba" returned: 0 in 0.285s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Lock "cinder-quobyte-04c30aff-eda2-4307-a60c-ecce28599eba" released by "delete_volume" :: held 0.803s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Created reservations ['69ee85d9-5239-4659-a37d-c0207206ddfa', 'cdff7124-0dd5-4f83-84af-5b150b09fa55', '43fe7918-e72e-4ed6-aa1f-0e2a2c0903c0', '685a2dc4-b53f-4de0-b983-4b4cc371c19f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:13 devstack sudo[101260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:13 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:13 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 1G" returned: 0 in 0.763s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:13 devstack sudo[101262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024
Nov 03 17:05:13 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:13 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.410s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Deleted volume successfully.
Nov 03 17:05:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eec7c36e-fadd-4ae0-ade2-d42c22187b16 tempest-VolumesImageMetadata-975666 None] Lock "cinder-04c30aff-eda2-4307-a60c-ecce28599eba-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:14 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024" returned: 0 in 0.488s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:14 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 is being set with open permissions: ugo+rw
Nov 03 17:05:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:14 devstack sudo[101268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024
Nov 03 17:05:14 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:14 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024" returned: 0 in 0.413s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:14 devstack sudo[101305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.info
Nov 03 17:05:14 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:14 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.info" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:14 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.info is being set with open permissions: ugo+rw
Nov 03 17:05:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:15 devstack sudo[101310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.info
Nov 03 17:05:15 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:15 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.info" returned: 0 in 0.308s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.136s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a9718bd0-d2e9-4aaf-877c-b08cdca4c728 tempest-SnapshotsActionsTest-1502555873 None] Create snapshot completed successfully
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Flow 'volume_create_manager' (af46ee09-e8a1-4ee8-8476-918241710b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fdd9c6-5a52-48aa-8f32-9e1f0e23be47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fdd9c6-5a52-48aa-8f32-9e1f0e23be47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-225976576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010217f9-0da7-4de1-9ac1-0e00794bd029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34744284f0b46449c230f2ac848b598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:16Z,use_quota=True,user_id='099516025d114455bc9873c945d81016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34adb6a-5a4c-46e8-b6af-35de7e4d6e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34adb6a-5a4c-46e8-b6af-35de7e4d6e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c793a95-1dd0-4b0e-897a-7b250bb0587e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c793a95-1dd0-4b0e-897a-7b250bb0587e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010217f9-0da7-4de1-9ac1-0e00794bd029', 'volume_name': 'volume-010217f9-0da7-4de1-9ac1-0e00794bd029', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932a50e0-202b-4cd7-8b27-b230fb6dd0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932a50e0-202b-4cd7-8b27-b230fb6dd0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da8a29d-9883-4717-887f-f1d37ae345cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume 010217f9-0da7-4de1-9ac1-0e00794bd029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010217f9-0da7-4de1-9ac1-0e00794bd029', 'volume_size': 1}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-225976576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010217f9-0da7-4de1-9ac1-0e00794bd029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34744284f0b46449c230f2ac848b598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:16Z,use_quota=True,user_id='099516025d114455bc9873c945d81016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Creating volume 010217f9-0da7-4de1-9ac1-0e00794bd029 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:16 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-010217f9-0da7-4de1-9ac1-0e00794bd029 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:16 devstack sudo[101313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-010217f9-0da7-4de1-9ac1-0e00794bd029 1073741824
Nov 03 17:05:16 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:16 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-010217f9-0da7-4de1-9ac1-0e00794bd029 1073741824" returned: 0 in 0.538s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-010217f9-0da7-4de1-9ac1-0e00794bd029 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:17 devstack sudo[101319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-010217f9-0da7-4de1-9ac1-0e00794bd029
Nov 03 17:05:17 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:17 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-010217f9-0da7-4de1-9ac1-0e00794bd029" returned: 0 in 0.312s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.024s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] Creating offline snapshot 89087070-5a9e-4ff7-93cf-fed42c1aaf23 of volume c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da8a29d-9883-4717-887f-f1d37ae345cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010217f9-0da7-4de1-9ac1-0e00794bd029', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa11f89-190e-446f-9f57-355ca9227258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ee8e15-97ed-400e-b3bd-b22034172284]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume volume-010217f9-0da7-4de1-9ac1-0e00794bd029 (010217f9-0da7-4de1-9ac1-0e00794bd029): created successfully
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa11f89-190e-446f-9f57-355ca9227258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Flow 'volume_create_manager' (af46ee09-e8a1-4ee8-8476-918241710b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3152346e-b9fb-40ba-a8c8-1afe58b29360 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Created volume successfully.
Nov 03 17:05:17 devstack sudo[101322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024
Nov 03 17:05:17 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:17 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024" returned: 0 in 0.370s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67c5072-da8b-4e24-8fbc-bd29281c507b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:17 devstack sudo[101327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23 1G
Nov 03 17:05:17 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:18 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23 1G" returned: 0 in 0.549s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:18 devstack sudo[101333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23
Nov 03 17:05:18 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:18 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:18 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23 is being set with open permissions: ugo+rw
Nov 03 17:05:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:18 devstack sudo[101339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23
Nov 03 17:05:18 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:18 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23" returned: 0 in 0.310s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.712s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0142e0e4-452a-4cfc-95a3-43528323a421 tempest-SnapshotsActionsTest-1502555873 None] Create snapshot completed successfully
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Flow 'volume_create_manager' (82d7f03f-18ca-4b3c-822f-e1b6de4ebffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f01ff02-200d-4142-86d7-70d2dc3ec10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f01ff02-200d-4142-86d7-70d2dc3ec10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1322709057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2916c4-b373-48a7-b63a-cc18e11e7f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34744284f0b46449c230f2ac848b598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:19Z,use_quota=True,user_id='099516025d114455bc9873c945d81016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6baea3-e02d-48eb-9d82-0381d2d058cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6baea3-e02d-48eb-9d82-0381d2d058cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3940bed8-14e4-4e76-88d5-aef4ad51c723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3940bed8-14e4-4e76-88d5-aef4ad51c723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff2916c4-b373-48a7-b63a-cc18e11e7f0c', 'volume_name': 'volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e585bd-3f41-4af6-94ad-02296c6737de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e585bd-3f41-4af6-94ad-02296c6737de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca9187a-a19e-4197-b43e-b0166339432c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume ff2916c4-b373-48a7-b63a-cc18e11e7f0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c', 'volume_size': 1}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1322709057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2916c4-b373-48a7-b63a-cc18e11e7f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34744284f0b46449c230f2ac848b598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:19Z,use_quota=True,user_id='099516025d114455bc9873c945d81016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Creating volume ff2916c4-b373-48a7-b63a-cc18e11e7f0c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:19 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:19 devstack sudo[101342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c 1073741824
Nov 03 17:05:19 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Flow 'volume_create_manager' (52275ca8-8fbf-4e49-8a15-500b78f196b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf16b4f-34f2-460b-81b8-d7abceb5ca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf16b4f-34f2-460b-81b8-d7abceb5ca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1700418074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ca8a5f-9f8c-410e-a916-8122a64ce738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34744284f0b46449c230f2ac848b598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:19Z,use_quota=True,user_id='099516025d114455bc9873c945d81016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8861850e-81da-45a7-aa6f-a78c2db62b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8861850e-81da-45a7-aa6f-a78c2db62b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b11ef6-430f-475b-92d4-f47db4791591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b11ef6-430f-475b-92d4-f47db4791591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ca8a5f-9f8c-410e-a916-8122a64ce738', 'volume_name': 'volume-22ca8a5f-9f8c-410e-a916-8122a64ce738', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716b4d6c-c168-4066-a4d0-baca82f4f081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716b4d6c-c168-4066-a4d0-baca82f4f081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9161108-a74f-47c0-8323-1be6851d2c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume 22ca8a5f-9f8c-410e-a916-8122a64ce738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ca8a5f-9f8c-410e-a916-8122a64ce738', 'volume_size': 1}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Flow 'volume_create_manager' (15b5bdd7-ab56-400b-9a14-55e869366471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:19 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfda0212-54d2-49fb-820b-c524efd13955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c 1073741824" returned: 0 in 0.755s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfda0212-54d2-49fb-820b-c524efd13955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1869247183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02e6a96-ad33-4a82-8185-c1a887296e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34744284f0b46449c230f2ac848b598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:20Z,use_quota=True,user_id='099516025d114455bc9873c945d81016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5e9670-1627-49c2-9e43-e45ebacddf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5e9670-1627-49c2-9e43-e45ebacddf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a11fb5-f5cf-4343-baa5-c9766abadfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a11fb5-f5cf-4343-baa5-c9766abadfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02e6a96-ad33-4a82-8185-c1a887296e1f', 'volume_name': 'volume-f02e6a96-ad33-4a82-8185-c1a887296e1f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f56861-09eb-4301-9fa7-3f25d1a03bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f56861-09eb-4301-9fa7-3f25d1a03bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ba6588-2b52-40bf-b5f8-231b4ae23527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume f02e6a96-ad33-4a82-8185-c1a887296e1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02e6a96-ad33-4a82-8185-c1a887296e1f', 'volume_size': 1}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:20 devstack sudo[101348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c
Nov 03 17:05:20 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Acquiring lock "cinder-89087070-5a9e-4ff7-93cf-fed42c1aaf23-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-89087070-5a9e-4ff7-93cf-fed42c1aaf23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Acquiring lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Acquiring lock "cinder-quobyte-89087070-5a9e-4ff7-93cf-fed42c1aaf23" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:20 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.785s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1700418074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ca8a5f-9f8c-410e-a916-8122a64ce738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34744284f0b46449c230f2ac848b598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:19Z,use_quota=True,user_id='099516025d114455bc9873c945d81016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Creating volume 22ca8a5f-9f8c-410e-a916-8122a64ce738 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:20 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-22ca8a5f-9f8c-410e-a916-8122a64ce738 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-89087070-5a9e-4ff7-93cf-fed42c1aaf23" acquired by "_delete_snapshot" :: waited 0.068s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:20 devstack sudo[101351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-22ca8a5f-9f8c-410e-a916-8122a64ce738 1073741824
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Deleting offline snapshot 89087070-5a9e-4ff7-93cf-fed42c1aaf23 of volume c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:05:20 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] snapshot_file for this snap is: volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca9187a-a19e-4197-b43e-b0166339432c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8621d567-2d53-47bc-ad03-2ddb1b4a6f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d9a4df-9180-49af-9dba-24b0cea6d008]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c (ff2916c4-b373-48a7-b63a-cc18e11e7f0c): created successfully
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8621d567-2d53-47bc-ad03-2ddb1b4a6f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Flow 'volume_create_manager' (82d7f03f-18ca-4b3c-822f-e1b6de4ebffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Flow 'volume_create_manager' (f9775c69-e09f-44d6-8067-1a94500d011d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08764491-180e-47fb-82b1-f4e0641aaddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2d5d3c1a-a2c9-4159-821d-f8ab9a275e13 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Created volume successfully.
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:20 devstack sudo[101354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23
Nov 03 17:05:20 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Flow 'volume_create_manager' (83ec98b1-c01d-41f3-bac7-bf2e0de85598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753435cc-4c13-42f8-bf15-e773e45bb2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753435cc-4c13-42f8-bf15-e773e45bb2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-424545569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af071923-8685-44da-91f3-78889829f96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34744284f0b46449c230f2ac848b598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:21Z,use_quota=True,user_id='099516025d114455bc9873c945d81016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7315e198-1917-4d8a-b882-a4fc01f2ddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7315e198-1917-4d8a-b882-a4fc01f2ddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52187392-087c-442c-b28c-bc0b03a9911a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52187392-087c-442c-b28c-bc0b03a9911a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af071923-8685-44da-91f3-78889829f96f', 'volume_name': 'volume-af071923-8685-44da-91f3-78889829f96f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4819c86-6f8e-47cc-a026-414c119987a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4819c86-6f8e-47cc-a026-414c119987a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49352abb-a272-4919-80d5-d699b3e51cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume af071923-8685-44da-91f3-78889829f96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af071923-8685-44da-91f3-78889829f96f', 'volume_size': 1}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08764491-180e-47fb-82b1-f4e0641aaddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-423674115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7da5d2-e490-43db-aefc-cb2ebe14fe64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb61d4bced942c0bb3da6dc1fbe3baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:20Z,use_quota=True,user_id='1899155de52741c7932a7324ba44334f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ba740e-0fa2-47e8-b02f-1dde401d5905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ba740e-0fa2-47e8-b02f-1dde401d5905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53723544-9ad5-438d-8c16-4a76068cb187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53723544-9ad5-438d-8c16-4a76068cb187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7da5d2-e490-43db-aefc-cb2ebe14fe64', 'volume_name': 'volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af03cda-ac40-46aa-bf74-d0ee7c9233bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af03cda-ac40-46aa-bf74-d0ee7c9233bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf65c978-30a4-4f43-98ed-6f10fa4e8d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Volume 6e7da5d2-e490-43db-aefc-cb2ebe14fe64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64', 'volume_size': 1}
Nov 03 17:05:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:21 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-22ca8a5f-9f8c-410e-a916-8122a64ce738 1073741824" returned: 0 in 0.598s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Flow 'volume_create_manager' (8c193059-a749-4f26-8214-c5b718a7060b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:21 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bb81c0-b5e7-4f11-9a80-166cf7d4c742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23" returned: 0 in 0.535s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67c5072-da8b-4e24-8fbc-bd29281c507b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bb81c0-b5e7-4f11-9a80-166cf7d4c742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781487731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54375625-169f-4711-8168-aaa1776fbc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34744284f0b46449c230f2ac848b598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:21Z,use_quota=True,user_id='099516025d114455bc9873c945d81016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1686cf39-b4ea-4c06-873b-98705ec4a95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1686cf39-b4ea-4c06-873b-98705ec4a95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0a4a1b-06e2-4a1c-98b2-10d0b7008a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0a4a1b-06e2-4a1c-98b2-10d0b7008a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54375625-169f-4711-8168-aaa1776fbc1e', 'volume_name': 'volume-54375625-169f-4711-8168-aaa1776fbc1e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca51fe2c-1cc7-444e-9bfb-e67a54fd1314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca51fe2c-1cc7-444e-9bfb-e67a54fd1314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aeeb188-37e5-4a55-8fdd-81aeb2c86ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:21 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume 54375625-169f-4711-8168-aaa1776fbc1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54375625-169f-4711-8168-aaa1776fbc1e', 'volume_size': 1}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5189eb4-657f-4be6-9a02-1877301c3952]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-22ca8a5f-9f8c-410e-a916-8122a64ce738 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:21 devstack sudo[101363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-22ca8a5f-9f8c-410e-a916-8122a64ce738
Nov 03 17:05:21 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:21 devstack sudo[101362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024
Nov 03 17:05:21 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:21 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-22ca8a5f-9f8c-410e-a916-8122a64ce738" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.402s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1869247183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02e6a96-ad33-4a82-8185-c1a887296e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34744284f0b46449c230f2ac848b598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:20Z,use_quota=True,user_id='099516025d114455bc9873c945d81016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Creating volume f02e6a96-ad33-4a82-8185-c1a887296e1f {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:21 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f02e6a96-ad33-4a82-8185-c1a887296e1f 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9161108-a74f-47c0-8323-1be6851d2c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ca8a5f-9f8c-410e-a916-8122a64ce738', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:21 devstack sudo[101368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f02e6a96-ad33-4a82-8185-c1a887296e1f 1073741824
Nov 03 17:05:21 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab376ec-e889-407c-9677-fb6780f42354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:21 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume volume-22ca8a5f-9f8c-410e-a916-8122a64ce738 (22ca8a5f-9f8c-410e-a916-8122a64ce738): created successfully
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab376ec-e889-407c-9677-fb6780f42354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Flow 'volume_create_manager' (52275ca8-8fbf-4e49-8a15-500b78f196b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-eaf58d88-24b4-4f46-be1f-7ba8431edbef tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Created volume successfully.
Nov 03 17:05:21 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024" returned: 0 in 0.377s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67c5072-da8b-4e24-8fbc-bd29281c507b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:21 devstack sudo[101372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23
Nov 03 17:05:21 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:21 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f02e6a96-ad33-4a82-8185-c1a887296e1f 1073741824" returned: 0 in 0.470s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:21 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23" returned: 0 in 0.396s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:22 devstack sudo[101381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23
Nov 03 17:05:22 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f02e6a96-ad33-4a82-8185-c1a887296e1f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:22 devstack sudo[101383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f02e6a96-ad33-4a82-8185-c1a887296e1f
Nov 03 17:05:22 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:22 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.89087070-5a9e-4ff7-93cf-fed42c1aaf23" returned: 0 in 0.279s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-89087070-5a9e-4ff7-93cf-fed42c1aaf23" released by "_delete_snapshot" :: held 1.785s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:22 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f02e6a96-ad33-4a82-8185-c1a887296e1f" returned: 0 in 0.287s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" released by "delete_snapshot" :: held 1.866s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-424545569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af071923-8685-44da-91f3-78889829f96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34744284f0b46449c230f2ac848b598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:21Z,use_quota=True,user_id='099516025d114455bc9873c945d81016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Creating volume af071923-8685-44da-91f3-78889829f96f {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:22 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af071923-8685-44da-91f3-78889829f96f 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:22 devstack sudo[101387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af071923-8685-44da-91f3-78889829f96f 1073741824
Nov 03 17:05:22 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ba6588-2b52-40bf-b5f8-231b4ae23527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02e6a96-ad33-4a82-8185-c1a887296e1f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc33eb2-3384-415d-b49c-244ffa59fb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume volume-f02e6a96-ad33-4a82-8185-c1a887296e1f (f02e6a96-ad33-4a82-8185-c1a887296e1f): created successfully
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc33eb2-3384-415d-b49c-244ffa59fb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Flow 'volume_create_manager' (15b5bdd7-ab56-400b-9a14-55e869366471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-58a6fd71-e513-43fa-adfd-771c379fdd57 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Created volume successfully.
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Created reservations ['adece513-85e8-4b59-8531-6b9ad83397bf', '51b30591-5962-47eb-8068-936735a37bea', '79e048ac-720c-42c0-87d1-e9cc66950cb0', '340acc25-991a-46f3-863d-62164a1dff30'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Delete snapshot completed successfully.
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6a6723e-32e3-4a7c-a59f-99d9157f2ed9 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-89087070-5a9e-4ff7-93cf-fed42c1aaf23-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:22 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af071923-8685-44da-91f3-78889829f96f 1073741824" returned: 0 in 0.522s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af071923-8685-44da-91f3-78889829f96f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:22 devstack sudo[101392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af071923-8685-44da-91f3-78889829f96f
Nov 03 17:05:22 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:23 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af071923-8685-44da-91f3-78889829f96f" returned: 0 in 0.279s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.162s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-423674115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7da5d2-e490-43db-aefc-cb2ebe14fe64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb61d4bced942c0bb3da6dc1fbe3baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:20Z,use_quota=True,user_id='1899155de52741c7932a7324ba44334f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Creating volume 6e7da5d2-e490-43db-aefc-cb2ebe14fe64 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:23 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49352abb-a272-4919-80d5-d699b3e51cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af071923-8685-44da-91f3-78889829f96f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:23 devstack sudo[101395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64 1073741824
Nov 03 17:05:23 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8011320e-b08e-4867-88db-52438a9319c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume volume-af071923-8685-44da-91f3-78889829f96f (af071923-8685-44da-91f3-78889829f96f): created successfully
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8011320e-b08e-4867-88db-52438a9319c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Flow 'volume_create_manager' (83ec98b1-c01d-41f3-bac7-bf2e0de85598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0cb5b685-ed92-4c30-a813-d6cb8cf06e52 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Created volume successfully.
Nov 03 17:05:23 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64 1073741824" returned: 0 in 0.543s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:23 devstack sudo[101401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64
Nov 03 17:05:23 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:24 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64" returned: 0 in 0.284s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.848s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781487731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54375625-169f-4711-8168-aaa1776fbc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34744284f0b46449c230f2ac848b598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:21Z,use_quota=True,user_id='099516025d114455bc9873c945d81016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Creating volume 54375625-169f-4711-8168-aaa1776fbc1e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:24 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54375625-169f-4711-8168-aaa1776fbc1e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf65c978-30a4-4f43-98ed-6f10fa4e8d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:24 devstack sudo[101404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54375625-169f-4711-8168-aaa1776fbc1e 1073741824
Nov 03 17:05:24 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ae83e9-5cbf-49ed-b66b-111c8843fef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:24 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Volume volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64 (6e7da5d2-e490-43db-aefc-cb2ebe14fe64): created successfully
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ae83e9-5cbf-49ed-b66b-111c8843fef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Flow 'volume_create_manager' (f9775c69-e09f-44d6-8067-1a94500d011d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a782c631-be07-4958-a8fa-75393932c4ac tempest-VolumesTransfersTest-1777070659 None] Created volume successfully.
Nov 03 17:05:24 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54375625-169f-4711-8168-aaa1776fbc1e 1073741824" returned: 0 in 0.469s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54375625-169f-4711-8168-aaa1776fbc1e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:24 devstack sudo[101410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54375625-169f-4711-8168-aaa1776fbc1e
Nov 03 17:05:24 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:24 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54375625-169f-4711-8168-aaa1776fbc1e" returned: 0 in 0.330s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.921s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] Creating offline snapshot edb1d317-688f-4693-9b9a-507aa476e7e4 of volume c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aeeb188-37e5-4a55-8fdd-81aeb2c86ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54375625-169f-4711-8168-aaa1776fbc1e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65dbc09-97d6-4043-9c72-fc5893754292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d109254f-686a-46dd-aedd-65ddc35015b2]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:25 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Volume volume-54375625-169f-4711-8168-aaa1776fbc1e (54375625-169f-4711-8168-aaa1776fbc1e): created successfully
Nov 03 17:05:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65dbc09-97d6-4043-9c72-fc5893754292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Flow 'volume_create_manager' (8c193059-a749-4f26-8214-c5b718a7060b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-93a00bef-c8d1-4aa6-b756-7d10cb08b507 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Created volume successfully.
Nov 03 17:05:25 devstack sudo[101413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024
Nov 03 17:05:25 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:25 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024" returned: 0 in 0.474s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67c5072-da8b-4e24-8fbc-bd29281c507b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:25 devstack sudo[101419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4 1G
Nov 03 17:05:25 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "cinder-54375625-169f-4711-8168-aaa1776fbc1e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-53f41079-e951-4309-a73b-fc510098d9f9 tempest-VolumesTransfersTest-936740931 None] Transfer volume completed successfully.
Nov 03 17:05:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-54375625-169f-4711-8168-aaa1776fbc1e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "cinder-quobyte-54375625-169f-4711-8168-aaa1776fbc1e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-quobyte-54375625-169f-4711-8168-aaa1776fbc1e" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:25 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3374f57a-a1f6-4cf3-9a85-3cd8d0d1ea48]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54375625-169f-4711-8168-aaa1776fbc1e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:25 devstack sudo[101421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54375625-169f-4711-8168-aaa1776fbc1e
Nov 03 17:05:25 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:26 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54375625-169f-4711-8168-aaa1776fbc1e" returned: 0 in 0.492s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54375625-169f-4711-8168-aaa1776fbc1e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:26 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4 1G" returned: 0 in 0.675s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:26 devstack sudo[101430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54375625-169f-4711-8168-aaa1776fbc1e
Nov 03 17:05:26 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:26 devstack sudo[101431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4
Nov 03 17:05:26 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Acquiring lock "cinder-6e7da5d2-e490-43db-aefc-cb2ebe14fe64-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Lock "cinder-6e7da5d2-e490-43db-aefc-cb2ebe14fe64-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Acquiring lock "cinder-quobyte-6e7da5d2-e490-43db-aefc-cb2ebe14fe64" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Lock "cinder-quobyte-6e7da5d2-e490-43db-aefc-cb2ebe14fe64" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b59854-adf2-4fee-8225-6f46f871193a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:26 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-54375625-169f-4711-8168-aaa1776fbc1e" returned: 0 in 0.306s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-quobyte-54375625-169f-4711-8168-aaa1776fbc1e" released by "delete_volume" :: held 0.852s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:26 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4" returned: 0 in 0.337s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:26 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4 is being set with open permissions: ugo+rw
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:26 devstack sudo[101434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64
Nov 03 17:05:26 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:26 devstack sudo[101439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4
Nov 03 17:05:26 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Created reservations ['4265a04e-5eec-4b38-b908-fbeaeabb4dab', 'daecc962-24dd-4b32-a81d-4323db596cda', 'ca5d3c3e-e02a-45a3-add0-7bc9a4537bc1', '9a1fd66f-780d-49fc-9a58-34359d165395'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:26 devstack sudo[101442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:26 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "cinder-af071923-8685-44da-91f3-78889829f96f-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-af071923-8685-44da-91f3-78889829f96f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:26 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64" returned: 0 in 0.432s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:26 devstack sudo[101448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64
Nov 03 17:05:26 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "cinder-quobyte-af071923-8685-44da-91f3-78889829f96f" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:26 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4" returned: 0 in 0.387s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-quobyte-af071923-8685-44da-91f3-78889829f96f" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d332d01-317d-4aa4-ae78-3396ba1a4017]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af071923-8685-44da-91f3-78889829f96f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:26 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.346s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:26 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-af130dc9-11b8-49de-819b-ac0fad56f031 tempest-SnapshotsActionsTest-1502555873 None] Create snapshot completed successfully
Nov 03 17:05:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Deleted volume successfully.
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20e42119-acdd-41b4-8c57-ca02b44f58de tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-54375625-169f-4711-8168-aaa1776fbc1e-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:27 devstack sudo[101451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af071923-8685-44da-91f3-78889829f96f
Nov 03 17:05:27 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:27 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-6e7da5d2-e490-43db-aefc-cb2ebe14fe64" returned: 0 in 0.346s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Lock "cinder-quobyte-6e7da5d2-e490-43db-aefc-cb2ebe14fe64" released by "delete_volume" :: held 0.845s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Created reservations ['bf0f6e66-2390-4e38-b546-052554068e61', '0be150cb-4976-4f36-9dc2-2ad1d9a31675', '78b289b8-ec38-4d52-9a6f-6069bcd82267', 'fe816d62-0cf9-4779-a115-8f320cab4c39'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Acquiring lock "cinder-edb1d317-688f-4693-9b9a-507aa476e7e4-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-edb1d317-688f-4693-9b9a-507aa476e7e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Acquiring lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Acquiring lock "cinder-quobyte-edb1d317-688f-4693-9b9a-507aa476e7e4" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:27 devstack sudo[101454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:27 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-edb1d317-688f-4693-9b9a-507aa476e7e4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Deleting offline snapshot edb1d317-688f-4693-9b9a-507aa476e7e4 of volume c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] snapshot_file for this snap is: volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79b3d54-6a60-43bc-989b-45a93e8b3c2b]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:27 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af071923-8685-44da-91f3-78889829f96f" returned: 0 in 0.558s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af071923-8685-44da-91f3-78889829f96f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:27 devstack sudo[101460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af071923-8685-44da-91f3-78889829f96f
Nov 03 17:05:27 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:27 devstack sudo[101459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4
Nov 03 17:05:27 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:27 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.318s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Deleted volume successfully.
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-18b6c700-9574-4c91-8383-bf039cd19b0d tempest-VolumesTransfersTest-1661377379 None] Lock "cinder-6e7da5d2-e490-43db-aefc-cb2ebe14fe64-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:27 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af071923-8685-44da-91f3-78889829f96f" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-quobyte-af071923-8685-44da-91f3-78889829f96f" released by "delete_volume" :: held 0.908s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Created reservations ['74b482e1-95af-44c1-a9a6-8a6b1794522b', '05cb5c46-6348-4373-a956-9bdfe67aa537', '0de0cda6-791b-42c2-af7b-312712b072cf', '3be4827c-7e64-4cb3-87ae-b99cd6089e0b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:27 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4" returned: 0 in 0.457s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67c5072-da8b-4e24-8fbc-bd29281c507b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa90b446-cc8e-474a-98bf-90dabdb43902]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "cinder-f02e6a96-ad33-4a82-8185-c1a887296e1f-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:28 devstack sudo[101469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:28 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:28 devstack sudo[101468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024
Nov 03 17:05:28 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-f02e6a96-ad33-4a82-8185-c1a887296e1f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "cinder-quobyte-f02e6a96-ad33-4a82-8185-c1a887296e1f" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Flow 'volume_create_manager' (30177e12-bc12-448e-9723-8264227de456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf27352-bcc9-4841-8a62-5de3d0e4e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-quobyte-f02e6a96-ad33-4a82-8185-c1a887296e1f" acquired by "delete_volume" :: waited 0.059s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf27352-bcc9-4841-8a62-5de3d0e4e82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-67844318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900a87cd-c526-405d-8ec7-3b9c97a85c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb61d4bced942c0bb3da6dc1fbe3baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:28Z,use_quota=True,user_id='1899155de52741c7932a7324ba44334f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b1dad3-f7a8-4048-ab38-08de1008c19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b1dad3-f7a8-4048-ab38-08de1008c19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec29aa77-147a-4de1-a0a1-c07646a02de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec29aa77-147a-4de1-a0a1-c07646a02de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '900a87cd-c526-405d-8ec7-3b9c97a85c6c', 'volume_name': 'volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21072216-4840-48fa-8133-a552f8363d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21072216-4840-48fa-8133-a552f8363d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22b5e72-2f43-4e4b-b583-70ee317583b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:28 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Volume 900a87cd-c526-405d-8ec7-3b9c97a85c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c', 'volume_size': 1}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-67844318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900a87cd-c526-405d-8ec7-3b9c97a85c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb61d4bced942c0bb3da6dc1fbe3baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:28Z,use_quota=True,user_id='1899155de52741c7932a7324ba44334f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Creating volume 900a87cd-c526-405d-8ec7-3b9c97a85c6c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:28 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:28 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9666bf-96e4-45f0-8fd6-571a9fa0e096]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f02e6a96-ad33-4a82-8185-c1a887296e1f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:28 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.368s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024" returned: 0 in 0.449s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:28 devstack sudo[101476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c 1073741824
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:28 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67c5072-da8b-4e24-8fbc-bd29281c507b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Deleted volume successfully.
Nov 03 17:05:28 devstack sudo[101479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-49ddc00e-4031-4618-befb-ce5d65c6cb3a tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-af071923-8685-44da-91f3-78889829f96f-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:28 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:28 devstack sudo[101477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f02e6a96-ad33-4a82-8185-c1a887296e1f
Nov 03 17:05:28 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:28 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:28 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f02e6a96-ad33-4a82-8185-c1a887296e1f" returned: 0 in 0.445s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c 1073741824" returned: 0 in 0.462s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f02e6a96-ad33-4a82-8185-c1a887296e1f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:28 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4" returned: 0 in 0.451s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:28 devstack sudo[101493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f02e6a96-ad33-4a82-8185-c1a887296e1f
Nov 03 17:05:28 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:28 devstack sudo[101495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4
Nov 03 17:05:28 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:28 devstack sudo[101497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c
Nov 03 17:05:28 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:29 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.edb1d317-688f-4693-9b9a-507aa476e7e4" returned: 0 in 0.265s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:29 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f02e6a96-ad33-4a82-8185-c1a887296e1f" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-edb1d317-688f-4693-9b9a-507aa476e7e4" released by "_delete_snapshot" :: held 1.778s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-quobyte-f02e6a96-ad33-4a82-8185-c1a887296e1f" released by "delete_volume" :: held 0.904s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" released by "delete_snapshot" :: held 1.808s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:29 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c" returned: 0 in 0.298s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22b5e72-2f43-4e4b-b583-70ee317583b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc0d55e-17b8-40ea-afd6-8d6edaaf010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:29 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Volume volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c (900a87cd-c526-405d-8ec7-3b9c97a85c6c): created successfully
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc0d55e-17b8-40ea-afd6-8d6edaaf010a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Flow 'volume_create_manager' (30177e12-bc12-448e-9723-8264227de456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-16e207d3-e910-41ce-847f-2f39100f60b6 tempest-VolumesTransfersTest-1777070659 None] Created volume successfully.
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Created reservations ['5748fbde-e912-4bee-b359-3f6d4cd12804', '5db95814-c7fe-434a-8c22-4fb6b464e0df', 'f2bc8f77-9f96-4106-87f1-d83d94e7969d', 'c70f7e54-f111-4a0a-99a9-fdd9a5372d96'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Created reservations ['c18f0a20-c774-40ab-bad0-56c27849613f', 'fb176c75-6053-474d-bec2-e52a9604bc82', 'deeb0df4-d86b-411e-9f0a-b50326b90f38', '9e0c0a2d-ace7-45e5-beaa-983830c29831'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:29 devstack sudo[101502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:29 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Delete snapshot completed successfully.
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ec70ff71-3221-4664-8314-dc071153bb7a tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-edb1d317-688f-4693-9b9a-507aa476e7e4-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:29 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Deleted volume successfully.
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-057395b7-383c-4ab9-b58d-9719ab1a9176 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-f02e6a96-ad33-4a82-8185-c1a887296e1f-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] Creating offline snapshot fe883816-c895-4fb4-a3a9-075f68aa54e1 of volume c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff75df5-0f70-4555-b238-eb8c08723d6a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:29 devstack sudo[101505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024
Nov 03 17:05:29 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:30 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024" returned: 0 in 0.352s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67c5072-da8b-4e24-8fbc-bd29281c507b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:30 devstack sudo[101510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1 1G
Nov 03 17:05:30 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "cinder-22ca8a5f-9f8c-410e-a916-8122a64ce738-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-22ca8a5f-9f8c-410e-a916-8122a64ce738-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "cinder-quobyte-22ca8a5f-9f8c-410e-a916-8122a64ce738" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-quobyte-22ca8a5f-9f8c-410e-a916-8122a64ce738" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[16095674-1f03-4bbb-a3b9-df04fe9506e9]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-22ca8a5f-9f8c-410e-a916-8122a64ce738 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Acquiring lock "cinder-900a87cd-c526-405d-8ec7-3b9c97a85c6c-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Lock "cinder-900a87cd-c526-405d-8ec7-3b9c97a85c6c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Acquiring lock "cinder-quobyte-900a87cd-c526-405d-8ec7-3b9c97a85c6c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Lock "cinder-quobyte-900a87cd-c526-405d-8ec7-3b9c97a85c6c" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:30 devstack sudo[101516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-22ca8a5f-9f8c-410e-a916-8122a64ce738
Nov 03 17:05:30 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[effa8c21-be83-4824-9aed-9f7a5576ec42]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:30 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1 1G" returned: 0 in 0.546s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:30 devstack sudo[101519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c
Nov 03 17:05:30 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:30 devstack sudo[101521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1
Nov 03 17:05:30 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:30 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-22ca8a5f-9f8c-410e-a916-8122a64ce738" returned: 0 in 0.445s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-22ca8a5f-9f8c-410e-a916-8122a64ce738 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:30 devstack sudo[101526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-22ca8a5f-9f8c-410e-a916-8122a64ce738
Nov 03 17:05:30 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:31 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c" returned: 0 in 0.409s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:31 devstack sudo[101533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c
Nov 03 17:05:31 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:31 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1" returned: 0 in 0.387s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:31 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1 is being set with open permissions: ugo+rw
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:31 devstack sudo[101537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1
Nov 03 17:05:31 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:31 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-22ca8a5f-9f8c-410e-a916-8122a64ce738" returned: 0 in 0.257s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-quobyte-22ca8a5f-9f8c-410e-a916-8122a64ce738" released by "delete_volume" :: held 0.750s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Created reservations ['7d07c557-a768-4bf5-bd2d-17b8de2b9755', '03f58293-7001-47f5-ad9f-7f05a1fa34c9', 'bf6b85cb-41be-4676-b4cd-27154933a10f', 'fc22cb46-213f-44dc-b371-1641501f3259'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:31 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-900a87cd-c526-405d-8ec7-3b9c97a85c6c" returned: 0 in 0.286s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Lock "cinder-quobyte-900a87cd-c526-405d-8ec7-3b9c97a85c6c" released by "delete_volume" :: held 0.747s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:31 devstack sudo[101541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:31 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:31 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1" returned: 0 in 0.270s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.652s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Created reservations ['88c58b98-e15d-422e-bb2d-84520dbf1ce2', 'c0cd1b58-1433-4404-9ff3-54accc476e53', '266ec246-3d87-487e-b27b-aeea1d5b4c93', '011c512f-c6cc-40b2-bc09-134f3bd0f2fa'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-77c74571-5cdb-4abe-8c1c-9493efe993fe tempest-SnapshotsActionsTest-1502555873 None] Create snapshot completed successfully
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "cinder-ff2916c4-b373-48a7-b63a-cc18e11e7f0c-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-ff2916c4-b373-48a7-b63a-cc18e11e7f0c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:31 devstack sudo[101543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:31 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "cinder-quobyte-ff2916c4-b373-48a7-b63a-cc18e11e7f0c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-quobyte-ff2916c4-b373-48a7-b63a-cc18e11e7f0c" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:31 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.329s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Deleted volume successfully.
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd9aac2-1b9f-49f6-847f-ba7204881622]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a7e856b6-eaad-47ce-9308-4dcfe0cef4ca tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-22ca8a5f-9f8c-410e-a916-8122a64ce738-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:31 devstack sudo[101546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c
Nov 03 17:05:31 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:31 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.411s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Deleted volume successfully.
Nov 03 17:05:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-94738273-15ac-4ede-badf-4248755f2a03 tempest-VolumesTransfersTest-1661377379 None] Lock "cinder-900a87cd-c526-405d-8ec7-3b9c97a85c6c-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Acquiring lock "cinder-fe883816-c895-4fb4-a3a9-075f68aa54e1-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-fe883816-c895-4fb4-a3a9-075f68aa54e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Acquiring lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Acquiring lock "cinder-quobyte-fe883816-c895-4fb4-a3a9-075f68aa54e1" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-fe883816-c895-4fb4-a3a9-075f68aa54e1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Deleting offline snapshot fe883816-c895-4fb4-a3a9-075f68aa54e1 of volume c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] snapshot_file for this snap is: volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:05:32 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c" returned: 0 in 0.463s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b1509e-8c37-4fca-adb1-a55f46befe30]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:32 devstack sudo[101552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c
Nov 03 17:05:32 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:32 devstack sudo[101553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1
Nov 03 17:05:32 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:32 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff2916c4-b373-48a7-b63a-cc18e11e7f0c" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-quobyte-ff2916c4-b373-48a7-b63a-cc18e11e7f0c" released by "delete_volume" :: held 0.800s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Created reservations ['862751ec-1090-4f79-a0a2-33ac79a805a2', '1dbd44c1-e093-4978-95ea-ddf57d1b0201', 'da25f2cd-0c12-48ea-be3e-e592278965ad', 'a9d656fd-2968-4923-a094-da9dde332340'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:32 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1" returned: 0 in 0.449s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67c5072-da8b-4e24-8fbc-bd29281c507b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:32 devstack sudo[101560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:32 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8b9ba5-0c3c-4561-997b-52f010afd8f5]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "cinder-010217f9-0da7-4de1-9ac1-0e00794bd029-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-010217f9-0da7-4de1-9ac1-0e00794bd029-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:32 devstack sudo[101562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024
Nov 03 17:05:32 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:32 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.283s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Deleted volume successfully.
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "cinder-quobyte-010217f9-0da7-4de1-9ac1-0e00794bd029" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-quobyte-010217f9-0da7-4de1-9ac1-0e00794bd029" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a2b366e-987f-4b67-9d4c-8a0471d1a6f8 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-ff2916c4-b373-48a7-b63a-cc18e11e7f0c-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:32 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5e85f6-20c3-4698-8dcb-d3e2a622f63a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-010217f9-0da7-4de1-9ac1-0e00794bd029 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:33 devstack sudo[101565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-010217f9-0da7-4de1-9ac1-0e00794bd029
Nov 03 17:05:33 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:33 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024" returned: 0 in 0.509s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67c5072-da8b-4e24-8fbc-bd29281c507b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:33 devstack sudo[101570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1
Nov 03 17:05:33 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:33 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-010217f9-0da7-4de1-9ac1-0e00794bd029" returned: 0 in 0.427s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-010217f9-0da7-4de1-9ac1-0e00794bd029 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:33 devstack sudo[101577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-010217f9-0da7-4de1-9ac1-0e00794bd029
Nov 03 17:05:33 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:33 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1" returned: 0 in 0.463s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:33 devstack sudo[101581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1
Nov 03 17:05:33 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:33 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-010217f9-0da7-4de1-9ac1-0e00794bd029" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-quobyte-010217f9-0da7-4de1-9ac1-0e00794bd029" released by "delete_volume" :: held 0.763s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Created reservations ['95279341-1a81-4ee9-898c-80c048b37557', 'e0ddde12-f985-45ef-b823-f46653ad95ae', '59129217-043e-48ca-9976-bbc267277e8c', 'a2f95120-27dd-43c8-958e-954371fa432e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:33 devstack sudo[101583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:33 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:33 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.fe883816-c895-4fb4-a3a9-075f68aa54e1" returned: 0 in 0.311s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-fe883816-c895-4fb4-a3a9-075f68aa54e1" released by "_delete_snapshot" :: held 1.890s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" released by "delete_snapshot" :: held 1.937s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:34 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Created reservations ['d6902d63-567b-49b6-ab74-2d910873d873', 'e6e84aca-90e7-45a5-a746-5ff2560e9984', '53ef546d-37f0-482e-b87a-17cbebf3b0bb', 'c6053478-a6ed-48fa-9478-3b8bbf0ef7a3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:34 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.326s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:34 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Deleted volume successfully.
Nov 03 17:05:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-03b875ae-7ea8-463e-afce-2f1686dde603 tempest-CreateVolumesFromSourceVolumeTest-1078033667 None] Lock "cinder-010217f9-0da7-4de1-9ac1-0e00794bd029-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Delete snapshot completed successfully.
Nov 03 17:05:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7ef524a5-a096-4687-937a-866c643c1143 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-fe883816-c895-4fb4-a3a9-075f68aa54e1-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] Creating offline snapshot 22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0 of volume c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:05:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a02d33-a5ee-44d7-b960-3545e96317fa]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:35 devstack sudo[101588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024
Nov 03 17:05:35 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:36 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024" returned: 0 in 0.420s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67c5072-da8b-4e24-8fbc-bd29281c507b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:36 devstack sudo[101593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0 1G
Nov 03 17:05:36 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:36 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0 1G" returned: 0 in 0.578s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:36 devstack sudo[101599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0
Nov 03 17:05:36 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:37 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0" returned: 0 in 0.353s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:37 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0 is being set with open permissions: ugo+rw
Nov 03 17:05:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:37 devstack sudo[101604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0
Nov 03 17:05:37 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:37 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0" returned: 0 in 0.269s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.760s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2806dcfd-bd2c-4ceb-a207-8dd9bedfa2e1 tempest-SnapshotsActionsTest-1502555873 None] Create snapshot completed successfully
Nov 03 17:05:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Acquiring lock "cinder-22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Acquiring lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Acquiring lock "cinder-quobyte-22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Deleting offline snapshot 22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0 of volume c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:05:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] snapshot_file for this snap is: volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:05:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c031ed43-9b27-49ec-9b9f-bca5008e9107]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:38 devstack sudo[101607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0
Nov 03 17:05:38 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:38 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0" returned: 0 in 0.466s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67c5072-da8b-4e24-8fbc-bd29281c507b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[463ae2aa-88a8-48e6-b7e2-af1b1a69b3a9]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:38 devstack sudo[101612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024
Nov 03 17:05:38 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:38 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024" returned: 0 in 0.469s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67c5072-da8b-4e24-8fbc-bd29281c507b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:39 devstack sudo[101617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0
Nov 03 17:05:39 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:39 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0" returned: 0 in 0.440s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:39 devstack sudo[101625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0
Nov 03 17:05:39 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:39 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0" returned: 0 in 0.293s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0" released by "_delete_snapshot" :: held 1.804s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" released by "delete_snapshot" :: held 1.837s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:39 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Created reservations ['7aea6eda-1bf9-45de-b131-dc2b06e5ea49', '32b2ec6e-f685-4a0a-858e-ccf2882fd53e', 'c92d8b95-e6f4-49ee-a8f4-47e5a3da3a4f', '7dd10110-6fe0-469a-9f8a-d8df52a58208'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Delete snapshot completed successfully.
Nov 03 17:05:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-17de356d-d801-49d7-9346-11425fdd5e55 tempest-SnapshotsActionsTest-1738899609 None] Lock "cinder-22d5fc80-a507-4ab6-a4cb-abbf41c9c5d0-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Acquiring lock "cinder-9fa0070a-3cd7-45d3-9277-ef6fcd35a024-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Lock "cinder-9fa0070a-3cd7-45d3-9277-ef6fcd35a024-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Acquiring lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Acquiring lock "cinder-quobyte-9fa0070a-3cd7-45d3-9277-ef6fcd35a024" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Lock "cinder-quobyte-9fa0070a-3cd7-45d3-9277-ef6fcd35a024" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Deleting offline snapshot 9fa0070a-3cd7-45d3-9277-ef6fcd35a024 of volume c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:05:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] snapshot_file for this snap is: volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:05:40 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[af84e6ad-c7eb-4842-96b0-72b56f86a909]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:40 devstack sudo[101630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024
Nov 03 17:05:40 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Flow 'volume_create_manager' (6ae1568e-792c-4588-9dca-dd7e333255be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed9bd24-90b3-4c96-9cff-9c714e276988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed9bd24-90b3-4c96-9cff-9c714e276988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1813183105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc84cdb8-07e2-4c40-a939-393b79efe903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bc7884dc1f4a15a8ce0dc91cd84c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:41Z,use_quota=True,user_id='91131c089c8b4ce5b9eebdb18776439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c8584b-74fc-4d19-a027-b5d5c67464fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c8584b-74fc-4d19-a027-b5d5c67464fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7405e4da-5d6e-4a96-ac8c-1daab66de650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7405e4da-5d6e-4a96-ac8c-1daab66de650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc84cdb8-07e2-4c40-a939-393b79efe903', 'volume_name': 'volume-bc84cdb8-07e2-4c40-a939-393b79efe903', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63275775-5eeb-4bcb-8214-55e7f0746c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63275775-5eeb-4bcb-8214-55e7f0746c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8e31b9-917e-40df-85b9-a872cb1d56a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Volume bc84cdb8-07e2-4c40-a939-393b79efe903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc84cdb8-07e2-4c40-a939-393b79efe903', 'volume_size': 1}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1813183105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc84cdb8-07e2-4c40-a939-393b79efe903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bc7884dc1f4a15a8ce0dc91cd84c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:41Z,use_quota=True,user_id='91131c089c8b4ce5b9eebdb18776439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Creating volume bc84cdb8-07e2-4c40-a939-393b79efe903 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:41 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc84cdb8-07e2-4c40-a939-393b79efe903 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:41 devstack sudo[101634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc84cdb8-07e2-4c40-a939-393b79efe903 1073741824
Nov 03 17:05:41 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:41 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024" returned: 0 in 0.401s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67c5072-da8b-4e24-8fbc-bd29281c507b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa06119-2965-44e0-9b5c-78c27b75278c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:41 devstack sudo[101637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b
Nov 03 17:05:41 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:41 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b" returned: 0 in 0.408s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:41 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc84cdb8-07e2-4c40-a939-393b79efe903 1073741824" returned: 0 in 0.542s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:41 devstack sudo[101646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024
Nov 03 17:05:41 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc84cdb8-07e2-4c40-a939-393b79efe903 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:41 devstack sudo[101648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc84cdb8-07e2-4c40-a939-393b79efe903
Nov 03 17:05:41 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:42 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc84cdb8-07e2-4c40-a939-393b79efe903" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8e31b9-917e-40df-85b9-a872cb1d56a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc84cdb8-07e2-4c40-a939-393b79efe903', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fea9cf9-0ded-4d9c-922a-c06314ae9202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Volume volume-bc84cdb8-07e2-4c40-a939-393b79efe903 (bc84cdb8-07e2-4c40-a939-393b79efe903): created successfully
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fea9cf9-0ded-4d9c-922a-c06314ae9202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Flow 'volume_create_manager' (6ae1568e-792c-4588-9dca-dd7e333255be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:42 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024" returned: 0 in 0.369s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e5a4e20d-889d-4f8e-b984-53ab0c176063 tempest-VolumesTransfersV355Test-1784555354 None] Created volume successfully.
Nov 03 17:05:42 devstack sudo[101654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024
Nov 03 17:05:42 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:42 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b.9fa0070a-3cd7-45d3-9277-ef6fcd35a024" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Lock "cinder-quobyte-9fa0070a-3cd7-45d3-9277-ef6fcd35a024" released by "_delete_snapshot" :: held 1.584s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" released by "delete_snapshot" :: held 1.611s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Created reservations ['6c4a1a5e-3e27-4303-be38-3437f52aa667', '661524c5-d552-4916-88b8-bc2bfef970a7', 'e46bd454-f395-44a6-be8e-78d785bcfa20', 'ef631a96-255c-45db-a417-eda178d8a4b7'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Delete snapshot completed successfully.
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-81af52c9-6aed-4c98-a75b-91bdd9411ee2 tempest-SnapshotsActionsTest-1502555873 None] Lock "cinder-9fa0070a-3cd7-45d3-9277-ef6fcd35a024-delete_snapshot" released by "delete_snapshot" :: held 1.763s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Acquiring lock "cinder-c67c5072-da8b-4e24-8fbc-bd29281c507b-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Lock "cinder-c67c5072-da8b-4e24-8fbc-bd29281c507b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Acquiring lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b13a720-bfe3-4983-a152-fc77d12ae735]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:43 devstack sudo[101659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b
Nov 03 17:05:43 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:43 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b" returned: 0 in 0.406s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:43 devstack sudo[101664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b
Nov 03 17:05:43 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:43 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c67c5072-da8b-4e24-8fbc-bd29281c507b" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Lock "cinder-quobyte-c67c5072-da8b-4e24-8fbc-bd29281c507b" released by "delete_volume" :: held 0.779s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Created reservations ['151dc82e-7ebc-4815-9ded-1a3a3fae4d67', '373c131b-92cf-4379-8ce6-d6b383884314', '62c20020-71a8-4422-9242-523ebf05d1d8', 'a62de692-33a9-40cd-9940-d5115fcc6f4a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:44 devstack sudo[101667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:44 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6590f489-90b1-4c5d-a53d-e4696bc4d502 tempest-VolumesTransfersV355Test-647673518 None] Transfer volume completed successfully.
Nov 03 17:05:44 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.308s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:44 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Deleted volume successfully.
Nov 03 17:05:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c9f6beac-0a84-4761-a84a-e5aa22a41ca4 tempest-SnapshotsActionsTest-1502555873 None] Lock "cinder-c67c5072-da8b-4e24-8fbc-bd29281c507b-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Acquiring lock "cinder-bc84cdb8-07e2-4c40-a939-393b79efe903-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Lock "cinder-bc84cdb8-07e2-4c40-a939-393b79efe903-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Acquiring lock "cinder-quobyte-bc84cdb8-07e2-4c40-a939-393b79efe903" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Lock "cinder-quobyte-bc84cdb8-07e2-4c40-a939-393b79efe903" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8036da-9987-40f4-b5be-6c313000c50c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc84cdb8-07e2-4c40-a939-393b79efe903 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:45 devstack sudo[101670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc84cdb8-07e2-4c40-a939-393b79efe903
Nov 03 17:05:45 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:45 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc84cdb8-07e2-4c40-a939-393b79efe903" returned: 0 in 0.406s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc84cdb8-07e2-4c40-a939-393b79efe903 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:45 devstack sudo[101675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc84cdb8-07e2-4c40-a939-393b79efe903
Nov 03 17:05:45 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:45 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bc84cdb8-07e2-4c40-a939-393b79efe903" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Lock "cinder-quobyte-bc84cdb8-07e2-4c40-a939-393b79efe903" released by "delete_volume" :: held 0.739s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=290,cinder:SELECT=206,cinder:INSERT=84,cinder:DELETE=29 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Created reservations ['2bf307a2-88fb-4abf-971c-f92cb3e36bfd', '0c107a34-ec9a-47f9-a7df-e7b4e6a14114', '5b28d83a-fe5c-497d-ac3a-2526d2d5b5fd', 'ef62f4cb-300a-4043-81fc-0ec46978b9be'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:46 devstack sudo[101678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:46 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:46 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.296s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Deleted volume successfully.
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d9ff9f02-6572-4471-946c-75c3c240c63c tempest-VolumesTransfersV355Test-2111432227 None] Lock "cinder-bc84cdb8-07e2-4c40-a939-393b79efe903-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Flow 'volume_create_manager' (dea07089-8d58-4af7-bbc6-3f2301050094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e0c735-58af-45b4-87f6-d482873006c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e0c735-58af-45b4-87f6-d482873006c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2034958029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d7b531-add1-4c8f-832d-8a281bfcea45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bc7884dc1f4a15a8ce0dc91cd84c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:47Z,use_quota=True,user_id='91131c089c8b4ce5b9eebdb18776439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a925f8e-e307-4af1-a136-02994d9e4a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a925f8e-e307-4af1-a136-02994d9e4a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60063f0b-0a40-4451-9533-6cd6f83e2401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60063f0b-0a40-4451-9533-6cd6f83e2401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59d7b531-add1-4c8f-832d-8a281bfcea45', 'volume_name': 'volume-59d7b531-add1-4c8f-832d-8a281bfcea45', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453cb81e-67fc-4c6a-bb97-daf3b5d441e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453cb81e-67fc-4c6a-bb97-daf3b5d441e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f49ba49-55b2-45ff-983f-16bb0ae1c3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:46 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Volume 59d7b531-add1-4c8f-832d-8a281bfcea45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59d7b531-add1-4c8f-832d-8a281bfcea45', 'volume_size': 1}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2034958029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d7b531-add1-4c8f-832d-8a281bfcea45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bc7884dc1f4a15a8ce0dc91cd84c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:47Z,use_quota=True,user_id='91131c089c8b4ce5b9eebdb18776439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Creating volume 59d7b531-add1-4c8f-832d-8a281bfcea45 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:05:46 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:05:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-59d7b531-add1-4c8f-832d-8a281bfcea45 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:46 devstack sudo[101681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-59d7b531-add1-4c8f-832d-8a281bfcea45 1073741824
Nov 03 17:05:46 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:47 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-59d7b531-add1-4c8f-832d-8a281bfcea45 1073741824" returned: 0 in 0.491s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-59d7b531-add1-4c8f-832d-8a281bfcea45 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:47 devstack sudo[101687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-59d7b531-add1-4c8f-832d-8a281bfcea45
Nov 03 17:05:47 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:47 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-59d7b531-add1-4c8f-832d-8a281bfcea45" returned: 0 in 0.257s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:05:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f49ba49-55b2-45ff-983f-16bb0ae1c3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d7b531-add1-4c8f-832d-8a281bfcea45', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4598d2-03f9-4584-af64-91fd0f0c12cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:05:47 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Volume volume-59d7b531-add1-4c8f-832d-8a281bfcea45 (59d7b531-add1-4c8f-832d-8a281bfcea45): created successfully
Nov 03 17:05:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4598d2-03f9-4584-af64-91fd0f0c12cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:05:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Flow 'volume_create_manager' (dea07089-8d58-4af7-bbc6-3f2301050094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:05:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-16ea901a-0547-477a-92ee-e873734b2045 tempest-VolumesTransfersV355Test-1784555354 None] Created volume successfully.
Nov 03 17:05:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Acquiring lock "cinder-59d7b531-add1-4c8f-832d-8a281bfcea45-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Lock "cinder-59d7b531-add1-4c8f-832d-8a281bfcea45-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Acquiring lock "cinder-quobyte-59d7b531-add1-4c8f-832d-8a281bfcea45" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:05:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Lock "cinder-quobyte-59d7b531-add1-4c8f-832d-8a281bfcea45" acquired by "delete_volume" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:05:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c0b1bf-a345-47ad-9510-674f47476c58]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:05:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-59d7b531-add1-4c8f-832d-8a281bfcea45 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:49 devstack sudo[101690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-59d7b531-add1-4c8f-832d-8a281bfcea45
Nov 03 17:05:49 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:49 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-59d7b531-add1-4c8f-832d-8a281bfcea45" returned: 0 in 0.369s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-59d7b531-add1-4c8f-832d-8a281bfcea45 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:49 devstack sudo[101696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-59d7b531-add1-4c8f-832d-8a281bfcea45
Nov 03 17:05:49 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:49 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-59d7b531-add1-4c8f-832d-8a281bfcea45" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Lock "cinder-quobyte-59d7b531-add1-4c8f-832d-8a281bfcea45" released by "delete_volume" :: held 0.666s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:50 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=206,cinder:UPDATE=281,cinder:INSERT=70,cinder:DELETE=17 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:05:50 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Created reservations ['17171cb4-fec6-42dd-aedd-f90a4e98bbd9', 'dddcc097-9975-40ec-aa31-6ab901f9bd49', '5446fc15-03c1-4343-a214-1c3c28bc1124', '5223854a-5bb4-45c3-ac66-ce86e5c47088'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:05:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:50 devstack sudo[101699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:50 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:50 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.284s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:50 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Deleted volume successfully.
Nov 03 17:05:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ea6739f-3212-469d-b3e3-3aecb1fa7708 tempest-VolumesTransfersV355Test-2111432227 None] Lock "cinder-59d7b531-add1-4c8f-832d-8a281bfcea45-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:05:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:05:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:05:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:05:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:05:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:05:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:05:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:05:51 devstack sudo[101703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:05:51 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:05:52 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root
Nov 03 17:05:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.347s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:05:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:05:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:05:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 29 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:05:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>, <Thread(Rabbit-heartbeat, started daemon 139029247180864)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:06:00 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:INSERT=3,cinder:UPDATE=19,cinder:SELECT=11,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:06:00 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:INSERT=2,cinder:UPDATE=6,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Flow 'volume_create_manager' (d0a7fff5-eb65-400e-a5c4-6d83a2587f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8ab0bd-08ab-4672-a5d4-3b3a5db932ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8ab0bd-08ab-4672-a5d4-3b3a5db932ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1000357268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b36e1d0-ac4e-433a-a0e5-922eb57de3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fc2a0c51ab4657903b022b2273735e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:08Z,use_quota=True,user_id='2422372390b84861934e2a6c4479f81d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d6351c-ca85-4df4-b66d-0d07e23bf945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d6351c-ca85-4df4-b66d-0d07e23bf945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fd448e-9fd4-4234-9def-f8c68af8fecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fd448e-9fd4-4234-9def-f8c68af8fecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b36e1d0-ac4e-433a-a0e5-922eb57de3b6', 'volume_name': 'volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69631ca-ad9c-4625-aa5b-ecbca02a3372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69631ca-ad9c-4625-aa5b-ecbca02a3372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c45508-351e-4cf8-8120-e4ec51f599fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:08 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Volume 3b36e1d0-ac4e-433a-a0e5-922eb57de3b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6', 'volume_size': 1}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1000357268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b36e1d0-ac4e-433a-a0e5-922eb57de3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fc2a0c51ab4657903b022b2273735e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:08Z,use_quota=True,user_id='2422372390b84861934e2a6c4479f81d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Creating volume 3b36e1d0-ac4e-433a-a0e5-922eb57de3b6 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:06:08 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:06:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:08 devstack sudo[101707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6 1073741824
Nov 03 17:06:08 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:09 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6 1073741824" returned: 0 in 0.532s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:09 devstack sudo[101713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6
Nov 03 17:06:09 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:09 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6" returned: 0 in 0.275s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c45508-351e-4cf8-8120-e4ec51f599fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572f73fb-520a-4888-ae89-1de58de28feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:09 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Volume volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6 (3b36e1d0-ac4e-433a-a0e5-922eb57de3b6): created successfully
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572f73fb-520a-4888-ae89-1de58de28feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Flow 'volume_create_manager' (d0a7fff5-eb65-400e-a5c4-6d83a2587f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:06:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c667074a-f248-494e-88b0-efdf22f756c0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Created volume successfully.
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Flow 'volume_create_manager' (4014d362-5e5f-4b1d-8851-5283bfcd0f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243a84d7-de46-4269-b102-76b6aac2838a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243a84d7-de46-4269-b102-76b6aac2838a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-759574918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295774d4-c88d-4152-9a68-08b7502a6b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f5c9348c5c4de0967ef08e322bce65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:10Z,use_quota=True,user_id='9a4cdefec7d34e0492b90375ffed2c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ef3415-79c0-429d-a309-f8784e0631a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ef3415-79c0-429d-a309-f8784e0631a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8dbc92-ac97-4842-bace-76f4db8da151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8dbc92-ac97-4842-bace-76f4db8da151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '295774d4-c88d-4152-9a68-08b7502a6b86', 'volume_name': 'volume-295774d4-c88d-4152-9a68-08b7502a6b86', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e961bd84-2fa5-4a9b-8b38-453e4754af35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e961bd84-2fa5-4a9b-8b38-453e4754af35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c20f59a-296f-40c1-912c-1155eeaacc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:09 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Volume 295774d4-c88d-4152-9a68-08b7502a6b86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-295774d4-c88d-4152-9a68-08b7502a6b86', 'volume_size': 1}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-759574918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295774d4-c88d-4152-9a68-08b7502a6b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f5c9348c5c4de0967ef08e322bce65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:10Z,use_quota=True,user_id='9a4cdefec7d34e0492b90375ffed2c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Creating volume 295774d4-c88d-4152-9a68-08b7502a6b86 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:06:09 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:06:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:09 devstack sudo[101716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 1073741824
Nov 03 17:06:09 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:10 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 1073741824" returned: 0 in 0.451s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:10 devstack sudo[101728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86
Nov 03 17:06:10 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:10 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86" returned: 0 in 0.249s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c20f59a-296f-40c1-912c-1155eeaacc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-295774d4-c88d-4152-9a68-08b7502a6b86', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fc9159-0e31-4ae0-8bac-3f624a5db7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:10 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Volume volume-295774d4-c88d-4152-9a68-08b7502a6b86 (295774d4-c88d-4152-9a68-08b7502a6b86): created successfully
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fc9159-0e31-4ae0-8bac-3f624a5db7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Flow 'volume_create_manager' (4014d362-5e5f-4b1d-8851-5283bfcd0f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:06:10 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-231ecf66-6f50-4a5a-870f-42404e4bf8e3 tempest-VolumesActionsTest-1008816561 None] Created volume successfully.
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Acquiring lock "cinder-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "cinder-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Acquiring lock "cinder-quobyte-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "cinder-quobyte-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b2445e-91b6-4708-8a22-356287863acb]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:06:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:10 devstack sudo[101732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6
Nov 03 17:06:10 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:11 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6" returned: 0 in 0.391s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:11 devstack sudo[101737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6
Nov 03 17:06:11 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:11 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "cinder-quobyte-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6" released by "delete_volume" :: held 0.719s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:06:11 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Created reservations ['e5484297-5f8e-4fa4-8ce6-00c3a35cf16a', '4aafc1cf-fc47-48f7-a798-2eea15e90441', 'ec04d363-4fc9-4554-b831-2ac875bb11ea', '0a818eb9-fe87-4565-9471-b1d9eb90122b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:06:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:06:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:06:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:06:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:06:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:11 devstack sudo[101743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:06:11 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:12 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.321s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:06:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Deleted volume successfully.
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-be140f94-ea85-49dc-b1c0-6a3af458fbb0 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "cinder-3b36e1d0-ac4e-433a-a0e5-922eb57de3b6-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Flow 'volume_create_manager' (56d17b32-0841-4694-a981-4434eb1be6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93011f1-6682-450f-aab2-1298b5d829a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93011f1-6682-450f-aab2-1298b5d829a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1886688838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e25b48-1158-4e31-a655-7b62e47464dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fc2a0c51ab4657903b022b2273735e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:12Z,use_quota=True,user_id='2422372390b84861934e2a6c4479f81d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a0c5a7-0b27-4d33-8dcb-aa3196662f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a0c5a7-0b27-4d33-8dcb-aa3196662f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4166312-92c7-4c69-9d84-ea0b75cfc789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4166312-92c7-4c69-9d84-ea0b75cfc789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04e25b48-1158-4e31-a655-7b62e47464dc', 'volume_name': 'volume-04e25b48-1158-4e31-a655-7b62e47464dc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d35b52-5349-462d-80b6-e18726ec10f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d35b52-5349-462d-80b6-e18726ec10f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17b1ffc-a5db-4124-8d83-78746fdc6807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:12 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Volume 04e25b48-1158-4e31-a655-7b62e47464dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04e25b48-1158-4e31-a655-7b62e47464dc', 'volume_size': 1}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1886688838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e25b48-1158-4e31-a655-7b62e47464dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fc2a0c51ab4657903b022b2273735e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:12Z,use_quota=True,user_id='2422372390b84861934e2a6c4479f81d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Creating volume 04e25b48-1158-4e31-a655-7b62e47464dc {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:06:12 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:06:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04e25b48-1158-4e31-a655-7b62e47464dc 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:12 devstack sudo[101746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04e25b48-1158-4e31-a655-7b62e47464dc 1073741824
Nov 03 17:06:12 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:13 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04e25b48-1158-4e31-a655-7b62e47464dc 1073741824" returned: 0 in 0.557s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04e25b48-1158-4e31-a655-7b62e47464dc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:13 devstack sudo[101753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04e25b48-1158-4e31-a655-7b62e47464dc
Nov 03 17:06:13 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:13 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04e25b48-1158-4e31-a655-7b62e47464dc" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:06:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:06:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17b1ffc-a5db-4124-8d83-78746fdc6807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04e25b48-1158-4e31-a655-7b62e47464dc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c700c2-86e4-4ee0-bf63-1347791e08d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:13 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Volume volume-04e25b48-1158-4e31-a655-7b62e47464dc (04e25b48-1158-4e31-a655-7b62e47464dc): created successfully
Nov 03 17:06:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c700c2-86e4-4ee0-bf63-1347791e08d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Flow 'volume_create_manager' (56d17b32-0841-4694-a981-4434eb1be6e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:06:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5e7e923b-985b-4175-8608-1d7acbb4d181 tempest-VolumeQuotasAdminTestJSON-2117637069 None] Created volume successfully.
Nov 03 17:06:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-86f3cfe5-06f6-439e-a6a1-b57d44589d23 tempest-VolumeQuotasAdminTestJSON-555489131 None] Transfer volume completed successfully.
Nov 03 17:06:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Acquiring lock "cinder-04e25b48-1158-4e31-a655-7b62e47464dc-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:06:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Lock "cinder-04e25b48-1158-4e31-a655-7b62e47464dc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:06:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Acquiring lock "cinder-quobyte-04e25b48-1158-4e31-a655-7b62e47464dc" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:06:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Lock "cinder-quobyte-04e25b48-1158-4e31-a655-7b62e47464dc" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:06:16 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[02819f65-1a60-4bf9-b224-59c36db4c545]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:06:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04e25b48-1158-4e31-a655-7b62e47464dc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:16 devstack sudo[101866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04e25b48-1158-4e31-a655-7b62e47464dc
Nov 03 17:06:16 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:16 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04e25b48-1158-4e31-a655-7b62e47464dc" returned: 0 in 0.509s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04e25b48-1158-4e31-a655-7b62e47464dc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:16 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04e25b48-1158-4e31-a655-7b62e47464dc
Nov 03 17:06:16 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:17 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-04e25b48-1158-4e31-a655-7b62e47464dc" returned: 0 in 0.279s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Lock "cinder-quobyte-04e25b48-1158-4e31-a655-7b62e47464dc" released by "delete_volume" :: held 0.868s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:06:17 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Created reservations ['d295388f-5fff-4410-9e8a-32d91bc7daa3', '4a9bbb82-da96-4697-97d9-12e2bb1cbbd9', 'ff8622e9-fdeb-4bbf-b38c-e490c68f7630', '4a31356b-ca87-4258-b40f-e0574ce26868'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:06:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:06:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:06:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:06:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:06:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:17 devstack sudo[101886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:06:17 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:17 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.384s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:17 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:06:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Deleted volume successfully.
Nov 03 17:06:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db870355-cf1f-4f4f-b9c1-5cea4584dba2 tempest-VolumeQuotasAdminTestJSON-1530650731 None] Lock "cinder-04e25b48-1158-4e31-a655-7b62e47464dc-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:06:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db340edc-82b8-487c-bc16-d3690da7b41c tempest-VolumesActionsTest-1008816561 None] Acquiring lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86" by "attach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:06:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db340edc-82b8-487c-bc16-d3690da7b41c tempest-VolumesActionsTest-1008816561 None] Lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86" acquired by "attach_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:06:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-db340edc-82b8-487c-bc16-d3690da7b41c tempest-VolumesActionsTest-1008816561 None] Attaching volume 295774d4-c88d-4152-9a68-08b7502a6b86 to instance fc18b967-a927-42a9-a84f-44aacdf74e29 at mountpoint /dev/vdb on host None.
Nov 03 17:06:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-db340edc-82b8-487c-bc16-d3690da7b41c tempest-VolumesActionsTest-1008816561 None] Attach volume completed successfully.
Nov 03 17:06:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-db340edc-82b8-487c-bc16-d3690da7b41c tempest-VolumesActionsTest-1008816561 None] Lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86" released by "attach_volume" :: held 0.119s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:06:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5424342f-532c-45c8-91f7-a4c6a380c664 tempest-VolumesActionsTest-1008816561 None] Acquiring lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86-detach_volume" by "detach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:06:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5424342f-532c-45c8-91f7-a4c6a380c664 tempest-VolumesActionsTest-1008816561 None] Lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:06:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5424342f-532c-45c8-91f7-a4c6a380c664 tempest-VolumesActionsTest-1008816561 None] Detaching volume 295774d4-c88d-4152-9a68-08b7502a6b86 from instance fc18b967-a927-42a9-a84f-44aacdf74e29.
Nov 03 17:06:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5424342f-532c-45c8-91f7-a4c6a380c664 tempest-VolumesActionsTest-1008816561 None] Detach volume completed successfully.
Nov 03 17:06:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5424342f-532c-45c8-91f7-a4c6a380c664 tempest-VolumesActionsTest-1008816561 None] Lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Flow 'volume_create_manager' (ba755dc9-2644-4ec7-80b6-8ce0ebfef3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e891ec-5fc5-4f51-b507-98b27d033950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e891ec-5fc5-4f51-b507-98b27d033950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-202292347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e1bc97002e47eaac0a2e94d3727f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:26Z,use_quota=True,user_id='32f68f3e7e054805aa709106bd906d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2f5a90-8513-441e-8e69-c7da527920c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2f5a90-8513-441e-8e69-c7da527920c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650eb0fe-11f0-4d72-b013-212e179e24cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650eb0fe-11f0-4d72-b013-212e179e24cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a', 'volume_name': 'volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e133beed-ea60-4831-9bd6-7e806fea78cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e133beed-ea60-4831-9bd6-7e806fea78cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82381e3-2670-4a92-b70e-f6b0ed12f071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Volume 489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a', 'volume_size': 1}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-202292347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e1bc97002e47eaac0a2e94d3727f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:26Z,use_quota=True,user_id='32f68f3e7e054805aa709106bd906d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Creating volume 489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:06:26 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:06:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:26 devstack sudo[101934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a 1073741824
Nov 03 17:06:26 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:27 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a 1073741824" returned: 0 in 0.881s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:27 devstack sudo[102002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a
Nov 03 17:06:27 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:27 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a" returned: 0 in 0.295s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:06:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:06:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82381e3-2670-4a92-b70e-f6b0ed12f071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02252b88-07d4-4517-8f2f-7912934d7754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:27 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Volume volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a (489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a): created successfully
Nov 03 17:06:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02252b88-07d4-4517-8f2f-7912934d7754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Flow 'volume_create_manager' (ba755dc9-2644-4ec7-80b6-8ce0ebfef3a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:06:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-86a1f5af-b41b-4b1c-9635-23277623c6c2 tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Created volume successfully.
Nov 03 17:06:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5a4b9c0b-7085-4b2a-906c-31f02075171a tempest-VolumesActionsTest-1008816561 None] Acquiring lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86" by "attach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:06:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5a4b9c0b-7085-4b2a-906c-31f02075171a tempest-VolumesActionsTest-1008816561 None] Lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86" acquired by "attach_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:06:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5a4b9c0b-7085-4b2a-906c-31f02075171a tempest-VolumesActionsTest-1008816561 None] Attaching volume 295774d4-c88d-4152-9a68-08b7502a6b86 to instance 85274d7e-1952-4786-bed2-e0386febac5a at mountpoint /dev/vdb on host None.
Nov 03 17:06:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5a4b9c0b-7085-4b2a-906c-31f02075171a tempest-VolumesActionsTest-1008816561 None] Attach volume completed successfully.
Nov 03 17:06:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5a4b9c0b-7085-4b2a-906c-31f02075171a tempest-VolumesActionsTest-1008816561 None] Lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86" released by "attach_volume" :: held 0.101s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:06:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e9b19cfc-1439-4492-837a-f14c5b24c961 tempest-VolumesActionsTest-1008816561 None] Acquiring lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86-detach_volume" by "detach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:06:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e9b19cfc-1439-4492-837a-f14c5b24c961 tempest-VolumesActionsTest-1008816561 None] Lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:06:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e9b19cfc-1439-4492-837a-f14c5b24c961 tempest-VolumesActionsTest-1008816561 None] Detaching volume 295774d4-c88d-4152-9a68-08b7502a6b86 from instance 85274d7e-1952-4786-bed2-e0386febac5a.
Nov 03 17:06:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e9b19cfc-1439-4492-837a-f14c5b24c961 tempest-VolumesActionsTest-1008816561 None] Detach volume completed successfully.
Nov 03 17:06:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e9b19cfc-1439-4492-837a-f14c5b24c961 tempest-VolumesActionsTest-1008816561 None] Lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:06:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Acquiring lock "cinder-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:06:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Lock "cinder-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:06:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Acquiring lock "cinder-quobyte-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:06:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Lock "cinder-quobyte-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a" acquired by "delete_volume" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:06:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d52deb-430f-4d3f-9a38-f649ffed10b2]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:06:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:30 devstack sudo[102011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a
Nov 03 17:06:30 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:30 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a" returned: 0 in 0.475s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:30 devstack sudo[102037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a
Nov 03 17:06:30 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:30 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Lock "cinder-quobyte-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a" released by "delete_volume" :: held 0.779s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:06:30 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Created reservations ['88499e31-8ab7-45d4-a2c2-994726ce4b46', '79ef1adf-e786-4f7f-b5da-6982e1a94fae', 'b3c57e15-cd37-43a5-9616-a245e78bd0d7', '2184786e-1df6-4e41-93a4-740b1e42537f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:06:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:06:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:06:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:06:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:06:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:31 devstack sudo[102040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:06:31 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:31 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.333s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:31 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:06:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Deleted volume successfully.
Nov 03 17:06:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45d842c5-13cf-45aa-bd86-43a772fd92dc tempest-VolumeQuotasNegativeTestJSON-1920948088 None] Lock "cinder-489f2dbc-dc56-47a2-a6cf-ce12dd8afb8a-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:06:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:06:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9f4d96-097a-465f-90fc-6b483f84b5a7]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:06:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:35 devstack sudo[102046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86
Nov 03 17:06:35 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:35 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86" returned: 0 in 0.395s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f83153-7259-4d23-b8a2-002bce72ddda]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:06:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:35 devstack sudo[102051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86
Nov 03 17:06:35 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:36 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86" returned: 0 in 0.380s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.7bf62382-6b01-4f4b-b2ab-34dcdadf221fpmny8oxh.img {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:36 devstack sudo[102056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.7bf62382-6b01-4f4b-b2ab-34dcdadf221fpmny8oxh.img
Nov 03 17:06:36 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:38 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:06:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Flow 'volume_create_manager' (26ec3386-c076-4e49-a7f6-faee75be429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:06:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ee74f2-cee7-40d2-afe8-6ab7da425019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ee74f2-cee7-40d2-afe8-6ab7da425019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-696304417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92afbd50-45f4-4439-ab5b-cafa7c41bba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b96c7461ef47adb3a43e997a79d772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:38Z,use_quota=True,user_id='4b96dcbabff545dda8106ab92b773b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f384631-f3b9-4c86-af50-e2069634b4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f384631-f3b9-4c86-af50-e2069634b4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6029210-66b6-4c25-8cef-94b0e372eef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6029210-66b6-4c25-8cef-94b0e372eef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92afbd50-45f4-4439-ab5b-cafa7c41bba3', 'volume_name': 'volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e50dec-7a2c-49ef-a450-ee1042a99d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e50dec-7a2c-49ef-a450-ee1042a99d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:06:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd3855b-eb2d-4469-87f8-a94220fd0194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:06:38 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Volume 92afbd50-45f4-4439-ab5b-cafa7c41bba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3', 'volume_size': 1}
Nov 03 17:06:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:41 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.7bf62382-6b01-4f4b-b2ab-34dcdadf221fpmny8oxh.img" returned: 0 in 5.750s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8c0833-12cc-4f02-ab56-da0626591aac]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:06:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:41 devstack sudo[102071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86
Nov 03 17:06:41 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:42 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86" returned: 0 in 0.542s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:42 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.7bf62382-6b01-4f4b-b2ab-34dcdadf221fpmny8oxh.img {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:06:42 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] Converted 1024.00 MB image at 178.06 MB/s
Nov 03 17:06:42 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] 7bf62382-6b01-4f4b-b2ab-34dcdadf221f was raw, no need to convert to raw {{(pid=87122) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 03 17:06:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:06:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:06:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:06:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:06:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:06:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:06:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:06:51 devstack sudo[102079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:06:51 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:06:52 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root
Nov 03 17:06:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.299s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:06:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:06:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:06:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 29 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:06:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>, <Thread(Rabbit-heartbeat, started daemon 139029247180864)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:06:52 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=40,cinder:UPDATE=47,cinder:DELETE=4,cinder:INSERT=11 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:06:52 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=39,cinder:INSERT=9,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:07:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.284s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] Uploaded volume to glance image-id: 7bf62382-6b01-4f4b-b2ab-34dcdadf221f. {{(pid=87122) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 03 17:07:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.946s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-696304417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92afbd50-45f4-4439-ab5b-cafa7c41bba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b96c7461ef47adb3a43e997a79d772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:38Z,use_quota=True,user_id='4b96dcbabff545dda8106ab92b773b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:07:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Creating volume 92afbd50-45f4-4439-ab5b-cafa7c41bba3 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:07:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:07:01 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:07:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:01 devstack sudo[102084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3 1073741824
Nov 03 17:07:01 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4fe52183-abde-4217-90d5-16e34c729afa tempest-VolumesActionsTest-1008816561 None] Copy volume to image completed successfully.
Nov 03 17:07:01 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3 1073741824" returned: 0 in 0.438s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:02 devstack sudo[102089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3
Nov 03 17:07:02 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:02 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3" returned: 0 in 0.284s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:07:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd3855b-eb2d-4469-87f8-a94220fd0194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ab36a4-8d23-4b93-b3af-e5a6fd5bf823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:02 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Volume volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3 (92afbd50-45f4-4439-ab5b-cafa7c41bba3): created successfully
Nov 03 17:07:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ab36a4-8d23-4b93-b3af-e5a6fd5bf823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Flow 'volume_create_manager' (26ec3386-c076-4e49-a7f6-faee75be429e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0dd41793-4053-4a11-a5f7-7e65b8fe4e66 tempest-VolumesListAdminTestJSON-876322668 None] Created volume successfully.
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ecd971-79a1-4d85-86d7-3c620f66b7bb]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:03 devstack sudo[102092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86
Nov 03 17:07:03 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Flow 'volume_create_manager' (ae0bccb5-9f02-409e-a19b-3aa6cb6589e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21946338-81c2-442b-a7fc-09778584e6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21946338-81c2-442b-a7fc-09778584e6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1439105131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115a83c3-5441-4bb6-85c8-56210629f7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b96c7461ef47adb3a43e997a79d772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:03Z,use_quota=True,user_id='4b96dcbabff545dda8106ab92b773b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d78f4c-cbf1-4fec-9fd5-c53d54db4aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d78f4c-cbf1-4fec-9fd5-c53d54db4aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c857c6-7cbf-4495-8493-3c7abd0f51ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c857c6-7cbf-4495-8493-3c7abd0f51ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '115a83c3-5441-4bb6-85c8-56210629f7c1', 'volume_name': 'volume-115a83c3-5441-4bb6-85c8-56210629f7c1', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51d5cd3-b5b2-4afe-aa2e-2cc5c6ad2af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51d5cd3-b5b2-4afe-aa2e-2cc5c6ad2af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ce4e3b-4546-4138-8307-13196dfc069b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:03 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Volume 115a83c3-5441-4bb6-85c8-56210629f7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-115a83c3-5441-4bb6-85c8-56210629f7c1', 'volume_size': 1}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:03 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86" returned: 0 in 0.426s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[839dbce2-2509-493b-b99e-a296e02251bc]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:03 devstack sudo[102097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86
Nov 03 17:07:03 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:03 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86" returned: 0 in 0.364s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:03 devstack sudo[102102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img
Nov 03 17:07:03 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:09 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img" returned: 0 in 5.335s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa78527-f437-44e0-a491-16ec214d0273]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:09 devstack sudo[102115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86
Nov 03 17:07:09 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:09 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86" returned: 0 in 0.528s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:09 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:07:09 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Converted 1024.00 MB image at 191.91 MB/s
Nov 03 17:07:09 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] e572e116-416f-4658-859c-51b6f734e58b was raw, converting to qcow2 {{(pid=87122) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 03 17:07:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f22889d-055a-46e1-bbff-5f4ff8789979]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:09 devstack sudo[102124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img
Nov 03 17:07:09 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:10 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img" returned: 0 in 0.318s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:10 devstack sudo[102130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img
Nov 03 17:07:10 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:10 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img" returned: 1 in 0.322s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:07:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img /opt/stack/data/cinder/conversion/vol_upload_vy4_e1a2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:10 devstack sudo[102135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img /opt/stack/data/cinder/conversion/vol_upload_vy4_e1a2
Nov 03 17:07:10 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:10 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img /opt/stack/data/cinder/conversion/vol_upload_vy4_e1a2" returned: 0 in 0.238s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:10 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Image conversion details: src /opt/stack/data/cinder/conversion/295774d4-c88d-4152-9a68-08b7502a6b86.temp_image.e572e116-416f-4658-859c-51b6f734e58bhnrz84_4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_vy4_e1a2 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:07:10 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 03 17:07:10 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedd115f-083d-4d4b-b250-f3e2dc6f140f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vy4_e1a2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:10 devstack sudo[102142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vy4_e1a2
Nov 03 17:07:10 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:11 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vy4_e1a2" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.143s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Uploaded volume to glance image-id: e572e116-416f-4658-859c-51b6f734e58b. {{(pid=87122) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.744s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1439105131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115a83c3-5441-4bb6-85c8-56210629f7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b96c7461ef47adb3a43e997a79d772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:03Z,use_quota=True,user_id='4b96dcbabff545dda8106ab92b773b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Creating volume 115a83c3-5441-4bb6-85c8-56210629f7c1 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:07:12 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-115a83c3-5441-4bb6-85c8-56210629f7c1 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ef8673ba-6253-4bf2-8542-53ded23f750a tempest-VolumesActionsTest-1008816561 None] Copy volume to image completed successfully.
Nov 03 17:07:12 devstack sudo[102148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-115a83c3-5441-4bb6-85c8-56210629f7c1 1073741824
Nov 03 17:07:12 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:12 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-115a83c3-5441-4bb6-85c8-56210629f7c1 1073741824" returned: 0 in 0.471s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-115a83c3-5441-4bb6-85c8-56210629f7c1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:12 devstack sudo[102154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-115a83c3-5441-4bb6-85c8-56210629f7c1
Nov 03 17:07:12 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:13 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-115a83c3-5441-4bb6-85c8-56210629f7c1" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ce4e3b-4546-4138-8307-13196dfc069b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115a83c3-5441-4bb6-85c8-56210629f7c1', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c83d3b8-e9d3-4051-aea2-dd13dd4cc3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:13 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Volume volume-115a83c3-5441-4bb6-85c8-56210629f7c1 (115a83c3-5441-4bb6-85c8-56210629f7c1): created successfully
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c83d3b8-e9d3-4051-aea2-dd13dd4cc3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Flow 'volume_create_manager' (ae0bccb5-9f02-409e-a19b-3aa6cb6589e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0e6df987-f155-42c0-a2eb-7ba605414143 tempest-VolumesListAdminTestJSON-876322668 None] Created volume successfully.
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Acquiring lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Acquiring lock "cinder-quobyte-295774d4-c88d-4152-9a68-08b7502a6b86" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Lock "cinder-quobyte-295774d4-c88d-4152-9a68-08b7502a6b86" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc1f55f-e8ff-4191-ab9d-f08bf2e77a18]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:13 devstack sudo[102157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86
Nov 03 17:07:13 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:13 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86" returned: 0 in 0.395s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:13 devstack sudo[102162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86
Nov 03 17:07:13 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Flow 'volume_create_manager' (cfe81884-8239-439e-aa6a-8c577b7fdc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80354794-afd5-4460-9444-91ac8bbfdcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:14 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80354794-afd5-4460-9444-91ac8bbfdcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-15613726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dee2d5d-38b8-4686-9636-c7f02522272d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b96c7461ef47adb3a43e997a79d772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:14Z,use_quota=True,user_id='4b96dcbabff545dda8106ab92b773b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3631de1-875f-4866-9933-c0476323c465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3631de1-875f-4866-9933-c0476323c465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fec0f4-82c5-4a89-b72a-e13dd2567e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fec0f4-82c5-4a89-b72a-e13dd2567e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dee2d5d-38b8-4686-9636-c7f02522272d', 'volume_name': 'volume-7dee2d5d-38b8-4686-9636-c7f02522272d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a525085-804e-42f6-8510-db729d5f47cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a525085-804e-42f6-8510-db729d5f47cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c95fde-4368-4383-80f4-fd604d83decd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:14 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Volume 7dee2d5d-38b8-4686-9636-c7f02522272d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dee2d5d-38b8-4686-9636-c7f02522272d', 'volume_size': 1}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-15613726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dee2d5d-38b8-4686-9636-c7f02522272d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b96c7461ef47adb3a43e997a79d772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:14Z,use_quota=True,user_id='4b96dcbabff545dda8106ab92b773b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Creating volume 7dee2d5d-38b8-4686-9636-c7f02522272d {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:07:14 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7dee2d5d-38b8-4686-9636-c7f02522272d 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-295774d4-c88d-4152-9a68-08b7502a6b86" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:14 devstack sudo[102165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7dee2d5d-38b8-4686-9636-c7f02522272d 1073741824
Nov 03 17:07:14 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Lock "cinder-quobyte-295774d4-c88d-4152-9a68-08b7502a6b86" released by "delete_volume" :: held 0.818s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Created reservations ['34cd6c44-c832-4275-8b82-61ba94855a70', '82532052-75ca-453e-beea-83049b01e8f1', 'c96f2732-c231-44d4-91ef-9838dd9a61d7', 'b3c8392b-4a50-480f-836b-f3cf34603215'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:14 devstack sudo[102167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:07:14 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:14 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.349s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:07:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Deleted volume successfully.
Nov 03 17:07:14 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7dee2d5d-38b8-4686-9636-c7f02522272d 1073741824" returned: 0 in 0.550s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0ed5cfd8-350b-4fa9-9a30-7140e798c4d3 tempest-VolumesActionsTest-1008816561 None] Lock "cinder-295774d4-c88d-4152-9a68-08b7502a6b86-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7dee2d5d-38b8-4686-9636-c7f02522272d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:14 devstack sudo[102174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7dee2d5d-38b8-4686-9636-c7f02522272d
Nov 03 17:07:14 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:14 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7dee2d5d-38b8-4686-9636-c7f02522272d" returned: 0 in 0.304s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c95fde-4368-4383-80f4-fd604d83decd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dee2d5d-38b8-4686-9636-c7f02522272d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c47a9f-da29-44d1-931c-74954145ecc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:15 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Volume volume-7dee2d5d-38b8-4686-9636-c7f02522272d (7dee2d5d-38b8-4686-9636-c7f02522272d): created successfully
Nov 03 17:07:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c47a9f-da29-44d1-931c-74954145ecc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Flow 'volume_create_manager' (cfe81884-8239-439e-aa6a-8c577b7fdc75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a7877ec0-6421-4a71-aa72-f51f61db428c tempest-VolumesListAdminTestJSON-876322668 None] Created volume successfully.
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Flow 'volume_create_manager' (b7443ec7-ca63-42df-9d22-6039456d636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e8ceec-3d16-4ddf-b9e9-959a2534c704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e8ceec-3d16-4ddf-b9e9-959a2534c704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fea6fd-24d1-4600-8b8e-0fdb7cd020d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07806b90096d42b9b4bb255561ba8ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:17Z,use_quota=True,user_id='4339b19e36de4d2cbd9eab1c0f32a869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ade64d9-747a-430b-90f5-c6ab06b1a625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ade64d9-747a-430b-90f5-c6ab06b1a625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766d15a7-87e4-49d2-913d-fac10c471c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766d15a7-87e4-49d2-913d-fac10c471c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30fea6fd-24d1-4600-8b8e-0fdb7cd020d3', 'volume_name': 'volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c968c271-21fc-4851-9415-cdc35929bab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c968c271-21fc-4851-9415-cdc35929bab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51853473-e393-494a-ad4c-9001e7e7a976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Volume 30fea6fd-24d1-4600-8b8e-0fdb7cd020d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3', 'volume_size': 1}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fea6fd-24d1-4600-8b8e-0fdb7cd020d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07806b90096d42b9b4bb255561ba8ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:17Z,use_quota=True,user_id='4339b19e36de4d2cbd9eab1c0f32a869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Creating volume 30fea6fd-24d1-4600-8b8e-0fdb7cd020d3 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:07:16 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:07:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:16 devstack sudo[102215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3 1073741824
Nov 03 17:07:16 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:17 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3 1073741824" returned: 0 in 0.410s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:17 devstack sudo[102220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3
Nov 03 17:07:17 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:17 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3" returned: 0 in 0.224s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:07:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51853473-e393-494a-ad4c-9001e7e7a976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7f8542-c716-483c-bc89-77fe03ca7a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Volume volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3 (30fea6fd-24d1-4600-8b8e-0fdb7cd020d3): created successfully
Nov 03 17:07:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7f8542-c716-483c-bc89-77fe03ca7a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Flow 'volume_create_manager' (b7443ec7-ca63-42df-9d22-6039456d636b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-777ed1d9-0809-41ad-ab8a-34e208cdc032 tempest-VolumesListAdminTestJSON-517827054 None] Created volume successfully.
Nov 03 17:07:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Acquiring lock "cinder-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Lock "cinder-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Acquiring lock "cinder-quobyte-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Lock "cinder-quobyte-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4b1051-5430-45d6-94ae-c684b6c58342]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "cinder-7dee2d5d-38b8-4686-9636-c7f02522272d-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Lock "cinder-7dee2d5d-38b8-4686-9636-c7f02522272d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "cinder-quobyte-7dee2d5d-38b8-4686-9636-c7f02522272d" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Lock "cinder-quobyte-7dee2d5d-38b8-4686-9636-c7f02522272d" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:18 devstack sudo[102223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3
Nov 03 17:07:18 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9b0f59-fdf1-4022-a918-78d0fc49aa85]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7dee2d5d-38b8-4686-9636-c7f02522272d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:18 devstack sudo[102225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7dee2d5d-38b8-4686-9636-c7f02522272d
Nov 03 17:07:18 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:18 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3" returned: 0 in 0.447s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:18 devstack sudo[102230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3
Nov 03 17:07:18 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:18 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7dee2d5d-38b8-4686-9636-c7f02522272d" returned: 0 in 0.432s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7dee2d5d-38b8-4686-9636-c7f02522272d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:18 devstack sudo[102235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7dee2d5d-38b8-4686-9636-c7f02522272d
Nov 03 17:07:18 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:18 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Lock "cinder-quobyte-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3" released by "delete_volume" :: held 0.831s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:18 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Created reservations ['ca3d02b0-25cb-44f0-9e23-9528b9a83087', '8c19e272-2385-4046-91b5-d0105850ebe1', '03570a8e-a403-44ec-9a27-7852eefa007f', 'ecbf9dda-ec39-40af-b082-c4832bdbfdac'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:19 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7dee2d5d-38b8-4686-9636-c7f02522272d" returned: 0 in 0.361s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:19 devstack sudo[102240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:07:19 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Lock "cinder-quobyte-7dee2d5d-38b8-4686-9636-c7f02522272d" released by "delete_volume" :: held 0.860s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Created reservations ['b12583f6-71d7-45d4-8da3-4b7449e49998', 'eac17841-df11-4e0c-aa36-1a14a5a22319', '726c7a63-149a-44ad-8aa9-869f5b4730e3', 'c04a8d05-7363-48cc-afd3-a38c3e376649'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:19 devstack sudo[102242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:07:19 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:19 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.297s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:07:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Deleted volume successfully.
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bc214678-de0d-4bf4-95c6-0290b50afdc1 tempest-VolumesListAdminTestJSON-517827054 None] Lock "cinder-30fea6fd-24d1-4600-8b8e-0fdb7cd020d3-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "cinder-115a83c3-5441-4bb6-85c8-56210629f7c1-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Lock "cinder-115a83c3-5441-4bb6-85c8-56210629f7c1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "cinder-quobyte-115a83c3-5441-4bb6-85c8-56210629f7c1" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Lock "cinder-quobyte-115a83c3-5441-4bb6-85c8-56210629f7c1" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:19 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.310s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:07:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Deleted volume successfully.
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[670ef71d-904f-45d2-8b3c-ac4586f01b83]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-115a83c3-5441-4bb6-85c8-56210629f7c1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f6c94b7-939d-4f36-bb01-200fc54602cf tempest-VolumesListAdminTestJSON-876322668 None] Lock "cinder-7dee2d5d-38b8-4686-9636-c7f02522272d-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:19 devstack sudo[102246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-115a83c3-5441-4bb6-85c8-56210629f7c1
Nov 03 17:07:19 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:19 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-115a83c3-5441-4bb6-85c8-56210629f7c1" returned: 0 in 0.408s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-115a83c3-5441-4bb6-85c8-56210629f7c1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:19 devstack sudo[102251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-115a83c3-5441-4bb6-85c8-56210629f7c1
Nov 03 17:07:19 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:20 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-115a83c3-5441-4bb6-85c8-56210629f7c1" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Lock "cinder-quobyte-115a83c3-5441-4bb6-85c8-56210629f7c1" released by "delete_volume" :: held 0.721s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Created reservations ['16393ebb-2678-4627-90a0-7930c0499424', '3f75c1b9-c789-442b-a804-7bc8584b7fba', 'dd2f2f75-46d8-44f3-8cc0-3a14ee474496', 'ebc2a4c8-4056-4bda-be05-f97a19d3854b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:20 devstack sudo[102254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:07:20 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:20 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.266s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:07:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Deleted volume successfully.
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e981a785-2551-4d59-8944-202deae75729 tempest-VolumesListAdminTestJSON-876322668 None] Lock "cinder-115a83c3-5441-4bb6-85c8-56210629f7c1-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "cinder-92afbd50-45f4-4439-ab5b-cafa7c41bba3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Lock "cinder-92afbd50-45f4-4439-ab5b-cafa7c41bba3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "cinder-quobyte-92afbd50-45f4-4439-ab5b-cafa7c41bba3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Lock "cinder-quobyte-92afbd50-45f4-4439-ab5b-cafa7c41bba3" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba504e8-47bd-40cc-834a-cffadee6abea]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:20 devstack sudo[102258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3
Nov 03 17:07:20 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:21 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3" returned: 0 in 0.423s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:21 devstack sudo[102263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3
Nov 03 17:07:21 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:21 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-92afbd50-45f4-4439-ab5b-cafa7c41bba3" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Lock "cinder-quobyte-92afbd50-45f4-4439-ab5b-cafa7c41bba3" released by "delete_volume" :: held 0.774s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Created reservations ['83c7ada7-f614-4ca2-ad1e-e9753a90d5d8', '37eb0299-e091-4503-a4e0-ee1d4f12db74', 'f8042a21-63c0-4756-93e4-b921454a3b1e', 'ba5730f4-001c-4eaa-b9e2-1ef9d74e5d22'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:21 devstack sudo[102266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:07:21 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:21 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:07:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Deleted volume successfully.
Nov 03 17:07:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f190dae8-9bf8-4d1f-9fc6-41e7021af94c tempest-VolumesListAdminTestJSON-876322668 None] Lock "cinder-92afbd50-45f4-4439-ab5b-cafa7c41bba3-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Flow 'volume_create_manager' (9ae9374c-14cc-4cf3-a8da-a3d5710503a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb0cba3-fe7e-43f4-97c0-da3a1ba92e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb0cba3-fe7e-43f4-97c0-da3a1ba92e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2080036665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042c3bac-0477-489d-a36e-bb6e3465fb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45580b36bee41b2a0ca10cac39bdf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:23Z,use_quota=True,user_id='0887a6d51ed04c669e2d7fa555e1b102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cb655c-6271-44e3-b79d-0fc5bb7b458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cb655c-6271-44e3-b79d-0fc5bb7b458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03dc308-57ff-4cb1-9814-d0026096d590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03dc308-57ff-4cb1-9814-d0026096d590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042c3bac-0477-489d-a36e-bb6e3465fb90', 'volume_name': 'volume-042c3bac-0477-489d-a36e-bb6e3465fb90', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239a59d7-6b8d-432a-90cc-014daeb6bcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239a59d7-6b8d-432a-90cc-014daeb6bcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6a2187-e6c7-4228-90be-9a69b5aca749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Volume 042c3bac-0477-489d-a36e-bb6e3465fb90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042c3bac-0477-489d-a36e-bb6e3465fb90', 'volume_size': 1}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2080036665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042c3bac-0477-489d-a36e-bb6e3465fb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45580b36bee41b2a0ca10cac39bdf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:23Z,use_quota=True,user_id='0887a6d51ed04c669e2d7fa555e1b102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Creating volume 042c3bac-0477-489d-a36e-bb6e3465fb90 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:07:22 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:07:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:22 devstack sudo[102269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90 1073741824
Nov 03 17:07:22 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:23 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90 1073741824" returned: 0 in 0.486s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:23 devstack sudo[102275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90
Nov 03 17:07:23 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:23 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90" returned: 0 in 0.262s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:07:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6a2187-e6c7-4228-90be-9a69b5aca749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042c3bac-0477-489d-a36e-bb6e3465fb90', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb782d1-c2ce-462e-a4c5-f8ec4c564365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Volume volume-042c3bac-0477-489d-a36e-bb6e3465fb90 (042c3bac-0477-489d-a36e-bb6e3465fb90): created successfully
Nov 03 17:07:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb782d1-c2ce-462e-a4c5-f8ec4c564365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Flow 'volume_create_manager' (9ae9374c-14cc-4cf3-a8da-a3d5710503a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e2a26639-646e-4d0c-9cec-b41e6bf435d9 tempest-VolumesCloneTest-1551790666 None] Created volume successfully.
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Flow 'volume_create_manager' (6bfbb424-2ee7-46e8-bbb0-04dfa7ee3559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b052de8-7ec1-487a-8131-e4d02859b7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b052de8-7ec1-487a-8131-e4d02859b7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1780269830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8ae172-8494-49d2-b202-856537849804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45580b36bee41b2a0ca10cac39bdf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=042c3bac-0477-489d-a36e-bb6e3465fb90,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:25Z,use_quota=True,user_id='0887a6d51ed04c669e2d7fa555e1b102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a1d28e-7bd1-4484-87b6-ef0413128a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a1d28e-7bd1-4484-87b6-ef0413128a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da32798a-71d0-41e4-879e-a174b967fa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da32798a-71d0-41e4-879e-a174b967fa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5a8ae172-8494-49d2-b202-856537849804', 'volume_name': 'volume-5a8ae172-8494-49d2-b202-856537849804', 'volume_size': 2, 'source_volid': '042c3bac-0477-489d-a36e-bb6e3465fb90', 'source_volstatus': 'available'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e76f43-af55-42c4-b65e-d7d65b122077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e76f43-af55-42c4-b65e-d7d65b122077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7461a1-8edb-4d1c-93ec-65d488b7aa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:25 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Volume 5a8ae172-8494-49d2-b202-856537849804: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5a8ae172-8494-49d2-b202-856537849804', 'volume_size': 2, 'source_volid': '042c3bac-0477-489d-a36e-bb6e3465fb90', 'source_volstatus': 'available'}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:25 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Cloning volume 042c3bac-0477-489d-a36e-bb6e3465fb90 to volume 5a8ae172-8494-49d2-b202-856537849804
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Creating offline snapshot ede1a1f4-870d-4dc9-a002-91825c6822e4 of volume 042c3bac-0477-489d-a36e-bb6e3465fb90 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d239b5c4-f5cf-4b0f-8d40-a9c79f84bc66]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:25 devstack sudo[102279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90
Nov 03 17:07:25 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:25 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90" returned: 0 in 0.445s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:25 devstack sudo[102284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4 1G
Nov 03 17:07:25 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:26 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4 1G" returned: 0 in 0.497s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-042c3bac-0477-489d-a36e-bb6e3465fb90 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:26 devstack sudo[102291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-042c3bac-0477-489d-a36e-bb6e3465fb90 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4
Nov 03 17:07:26 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:26 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-042c3bac-0477-489d-a36e-bb6e3465fb90 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4" returned: 0 in 0.336s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:26 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4 is being set with open permissions: ugo+rw
Nov 03 17:07:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:26 devstack sudo[102296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4
Nov 03 17:07:26 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:27 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:27 devstack sudo[102299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.info
Nov 03 17:07:27 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:27 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.info" returned: 0 in 0.265s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:27 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.info is being set with open permissions: ugo+rw
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:27 devstack sudo[102302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.info
Nov 03 17:07:27 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:27 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.info" returned: 0 in 0.240s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Acquiring lock "cinder-quobyte-5a8ae172-8494-49d2-b202-856537849804" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Lock "cinder-quobyte-5a8ae172-8494-49d2-b202-856537849804" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] snapshot: ede1a1f4-870d-4dc9-a002-91825c6822e4, volume: 5a8ae172-8494-49d2-b202-856537849804,  {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a462c6f1-65fc-4587-b453-46e43c04bb08]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:27 devstack sudo[102305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4
Nov 03 17:07:27 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:28 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4" returned: 0 in 0.402s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-042c3bac-0477-489d-a36e-bb6e3465fb90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:07:28 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87ed365-597b-4408-a25c-704512149477]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:28 devstack sudo[102310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90
Nov 03 17:07:28 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:28 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90" returned: 0 in 0.430s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 17:07:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 17:07:28 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Path /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 17:07:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:28 devstack sudo[102315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804
Nov 03 17:07:28 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:33 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:07:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Flow 'volume_create_manager' (ab1752b3-8efb-4dc3-adc2-db1e2669584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7521dd2d-39b2-43b0-bb9f-387bb0096099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7521dd2d-39b2-43b0-bb9f-387bb0096099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1092388200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b2deb0-0866-434f-81a9-ad9b1ad40a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c34d94eab3a462c8459b06283c68ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:33Z,use_quota=True,user_id='3f040fc0f7d5417cb053611cf55c93eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df635176-3cd4-4299-8afc-91b5f9f52b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df635176-3cd4-4299-8afc-91b5f9f52b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c487528-7b22-436d-86f3-5769d670e103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c487528-7b22-436d-86f3-5769d670e103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b2deb0-0866-434f-81a9-ad9b1ad40a25', 'volume_name': 'volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1207999f-9bbf-469d-8768-d4fdb1b6a3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1207999f-9bbf-469d-8768-d4fdb1b6a3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610d7f02-0db6-4014-b1cc-54cb30ca0332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Volume e4b2deb0-0866-434f-81a9-ad9b1ad40a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25', 'volume_size': 1}
Nov 03 17:07:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:34 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804" returned: 0 in 6.130s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:34 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:07:34 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Converted 1024.00 MB image at 167.02 MB/s
Nov 03 17:07:34 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804 is being set with open permissions: ugo+rw
Nov 03 17:07:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:34 devstack sudo[102329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804
Nov 03 17:07:34 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:34 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804" returned: 0 in 0.235s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Lock "cinder-quobyte-5a8ae172-8494-49d2-b202-856537849804" released by "_copy_volume_from_snapshot" :: held 7.279s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Acquiring lock "cinder-quobyte-ede1a1f4-870d-4dc9-a002-91825c6822e4" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Lock "cinder-quobyte-ede1a1f4-870d-4dc9-a002-91825c6822e4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Deleting offline snapshot ede1a1f4-870d-4dc9-a002-91825c6822e4 of volume 042c3bac-0477-489d-a36e-bb6e3465fb90 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:07:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] snapshot_file for this snap is: volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:07:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbcf71d-397c-416b-bf44-ab40e1b45afe]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:35 devstack sudo[102332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4
Nov 03 17:07:35 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:35 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4" returned: 0 in 0.350s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-042c3bac-0477-489d-a36e-bb6e3465fb90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:07:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cca491-0815-4bdf-b328-9ad25141ff95]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:35 devstack sudo[102338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90
Nov 03 17:07:35 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:35 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90" returned: 0 in 0.508s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:35 devstack sudo[102343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4
Nov 03 17:07:35 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:36 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4" returned: 0 in 0.338s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:36 devstack sudo[102348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4
Nov 03 17:07:36 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:36 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90.ede1a1f4-870d-4dc9-a002-91825c6822e4" returned: 0 in 0.261s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Lock "cinder-quobyte-ede1a1f4-870d-4dc9-a002-91825c6822e4" released by "_delete_snapshot" :: held 1.550s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.106s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.062s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1092388200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b2deb0-0866-434f-81a9-ad9b1ad40a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c34d94eab3a462c8459b06283c68ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:33Z,use_quota=True,user_id='3f040fc0f7d5417cb053611cf55c93eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Creating volume e4b2deb0-0866-434f-81a9-ad9b1ad40a25 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:07:36 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:36 devstack sudo[102351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 1073741824
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7461a1-8edb-4d1c-93ec-65d488b7aa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8ae172-8494-49d2-b202-856537849804', 'volume_size': 2, 'source_volid': '042c3bac-0477-489d-a36e-bb6e3465fb90', 'source_volstatus': 'available'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:36 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a641a3f6-1921-4990-b600-ddda5bebce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:36 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Volume volume-5a8ae172-8494-49d2-b202-856537849804 (5a8ae172-8494-49d2-b202-856537849804): created successfully
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a641a3f6-1921-4990-b600-ddda5bebce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Flow 'volume_create_manager' (6bfbb424-2ee7-46e8-bbb0-04dfa7ee3559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-04936f75-31a5-40d2-bcdc-c1fa8e2f0b88 tempest-VolumesCloneTest-1551790666 None] Created volume successfully.
Nov 03 17:07:36 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 1073741824" returned: 0 in 0.463s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:37 devstack sudo[102356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25
Nov 03 17:07:37 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:37 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" returned: 0 in 0.279s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610d7f02-0db6-4014-b1cc-54cb30ca0332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abed9296-bdb4-4d46-9d3e-280cf09d1402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:37 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Volume volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 (e4b2deb0-0866-434f-81a9-ad9b1ad40a25): created successfully
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abed9296-bdb4-4d46-9d3e-280cf09d1402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Flow 'volume_create_manager' (ab1752b3-8efb-4dc3-adc2-db1e2669584c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-59cd26d9-f08b-4259-a54b-485b3dd65e39 tempest-VolumesDeleteCascade-1763369285 None] Created volume successfully.
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Acquiring lock "cinder-5a8ae172-8494-49d2-b202-856537849804-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Lock "cinder-5a8ae172-8494-49d2-b202-856537849804-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Acquiring lock "cinder-quobyte-5a8ae172-8494-49d2-b202-856537849804" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Lock "cinder-quobyte-5a8ae172-8494-49d2-b202-856537849804" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b30ec55-95e6-4cd8-b106-ad4c3ea4b48f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:37 devstack sudo[102359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804
Nov 03 17:07:37 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] Creating offline snapshot 55ca9f18-5f42-4ae0-8486-baf543940a2f of volume e4b2deb0-0866-434f-81a9-ad9b1ad40a25 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[355b0009-a887-4b82-ab50-65f63fe126df]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:37 devstack sudo[102361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25
Nov 03 17:07:37 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:37 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804" returned: 0 in 0.412s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:37 devstack sudo[102366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804
Nov 03 17:07:37 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:38 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:38 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5a8ae172-8494-49d2-b202-856537849804" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" returned: 0 in 0.457s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Lock "cinder-quobyte-5a8ae172-8494-49d2-b202-856537849804" released by "delete_volume" :: held 0.722s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:38 devstack sudo[102372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f 1G
Nov 03 17:07:38 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Created reservations ['00f6f98c-91ae-4ef8-b30a-b1ccd3665d84', '66493597-e0ca-4e32-ae79-06dfaafe27ab', 'c8e4befb-4025-439d-9393-2e748737adb2', '0ed9f2db-be90-4a74-a9c1-1c38398b6699'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:38 devstack sudo[102374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:07:38 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:38 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.287s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:07:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Deleted volume successfully.
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-09afe0cd-bd29-4677-a258-3bb156b4df49 tempest-VolumesCloneTest-1551790666 None] Lock "cinder-5a8ae172-8494-49d2-b202-856537849804-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Acquiring lock "cinder-042c3bac-0477-489d-a36e-bb6e3465fb90-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:38 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f 1G" returned: 0 in 0.508s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Lock "cinder-042c3bac-0477-489d-a36e-bb6e3465fb90-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:38 devstack sudo[102380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f
Nov 03 17:07:38 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Acquiring lock "cinder-quobyte-042c3bac-0477-489d-a36e-bb6e3465fb90" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Lock "cinder-quobyte-042c3bac-0477-489d-a36e-bb6e3465fb90" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abed9e4-3d26-425b-81d9-42e740d81eb4]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:38 devstack sudo[102382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90
Nov 03 17:07:38 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:39 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f" returned: 0 in 0.332s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:39 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f is being set with open permissions: ugo+rw
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:39 devstack sudo[102387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f
Nov 03 17:07:39 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:39 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90" returned: 0 in 0.422s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:39 devstack sudo[102392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90
Nov 03 17:07:39 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:39 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f" returned: 0 in 0.276s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:39 devstack sudo[102395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.info
Nov 03 17:07:39 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:39 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-042c3bac-0477-489d-a36e-bb6e3465fb90" returned: 0 in 0.266s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Lock "cinder-quobyte-042c3bac-0477-489d-a36e-bb6e3465fb90" released by "delete_volume" :: held 0.765s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Created reservations ['5e2bc16d-f1e6-4b7a-ae69-d24c0eb0ebe6', 'c81de47b-db11-46e6-a774-847ffba9fbd7', '729f5292-8d47-41f5-b991-7a31b8e55384', '059ebb20-3478-412d-82bc-512eb023a123'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:07:39 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.info" returned: 0 in 0.266s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:39 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.info is being set with open permissions: ugo+rw
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:39 devstack sudo[102399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.info
Nov 03 17:07:39 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:39 devstack sudo[102401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:07:39 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:39 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.info" returned: 0 in 0.292s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-83555d68-b6a5-4bdb-bdec-cde2b24b20c9 tempest-VolumesDeleteCascade-1763369285 None] Create snapshot completed successfully
Nov 03 17:07:39 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:40 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:07:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Deleted volume successfully.
Nov 03 17:07:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6bcab3-e965-4335-8b35-7a515bccd877 tempest-VolumesCloneTest-1551790666 None] Lock "cinder-042c3bac-0477-489d-a36e-bb6e3465fb90-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] Creating offline snapshot 7546a344-3a49-4a0f-9140-eeb0aef65c19 of volume e4b2deb0-0866-434f-81a9-ad9b1ad40a25 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:07:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5b66e6-c1b2-4de9-b76e-f25c22427aca]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:41 devstack sudo[102407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f
Nov 03 17:07:41 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:41 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f" returned: 0 in 0.428s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:07:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:41 devstack sudo[102412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 1G
Nov 03 17:07:41 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:42 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 1G" returned: 0 in 0.463s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:42 devstack sudo[102418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19
Nov 03 17:07:42 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:42 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19" returned: 0 in 0.299s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:42 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 is being set with open permissions: ugo+rw
Nov 03 17:07:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:42 devstack sudo[102423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19
Nov 03 17:07:42 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:42 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19" returned: 0 in 0.242s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.542s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4da429bc-c41d-4c9c-8d7a-9d2e4cca2b8c tempest-VolumesDeleteCascade-1763369285 None] Create snapshot completed successfully
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-e4b2deb0-0866-434f-81a9-ad9b1ad40a25-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-e4b2deb0-0866-434f-81a9-ad9b1ad40a25-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Performing cascade delete. {{(pid=87122) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-55ca9f18-5f42-4ae0-8486-baf543940a2f-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-55ca9f18-5f42-4ae0-8486-baf543940a2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-quobyte-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-quobyte-55ca9f18-5f42-4ae0-8486-baf543940a2f" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-55ca9f18-5f42-4ae0-8486-baf543940a2f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Deleting offline snapshot 55ca9f18-5f42-4ae0-8486-baf543940a2f of volume e4b2deb0-0866-434f-81a9-ad9b1ad40a25 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] snapshot_file for this snap is: volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e1649e-0792-4e5c-8015-c1f45818d8e2]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:43 devstack sudo[102428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f
Nov 03 17:07:43 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:43 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f" returned: 0 in 0.427s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c330396f-3042-4377-ac8d-aae7e496f2da]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Flow 'volume_create_manager' (e0663112-ce29-4cf3-8cb8-705e36eced66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4cee5a-425c-45db-9d82-e48edbf3a09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4cee5a-425c-45db-9d82-e48edbf3a09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-71873256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea0d051-4000-409e-98da-acea7d447dab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8f92fc682f0494b905ba289b5cc58dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:44Z,use_quota=True,user_id='44f1b3fdf35b4e089d455a24f284f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547d7aad-922f-4416-93ea-b53fbca8c126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547d7aad-922f-4416-93ea-b53fbca8c126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916fde5d-ed38-46d3-a8f3-662e917b6363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916fde5d-ed38-46d3-a8f3-662e917b6363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea0d051-4000-409e-98da-acea7d447dab', 'volume_name': 'volume-5ea0d051-4000-409e-98da-acea7d447dab', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:44 devstack sudo[102433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25
Nov 03 17:07:44 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc19cbc-15e3-4b9e-97f2-9f2509c821b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc19cbc-15e3-4b9e-97f2-9f2509c821b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25e5cf4-5485-471b-af0b-6a764780a5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:44 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Volume 5ea0d051-4000-409e-98da-acea7d447dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea0d051-4000-409e-98da-acea7d447dab', 'volume_size': 1}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-71873256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea0d051-4000-409e-98da-acea7d447dab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8f92fc682f0494b905ba289b5cc58dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:44Z,use_quota=True,user_id='44f1b3fdf35b4e089d455a24f284f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Creating volume 5ea0d051-4000-409e-98da-acea7d447dab {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:07:44 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ea0d051-4000-409e-98da-acea7d447dab 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:44 devstack sudo[102435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ea0d051-4000-409e-98da-acea7d447dab 1073741824
Nov 03 17:07:44 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:44 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" returned: 0 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aadb0b0-d2db-4434-a01e-921925c59121]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:44 devstack sudo[102444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19
Nov 03 17:07:44 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:44 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ea0d051-4000-409e-98da-acea7d447dab 1073741824" returned: 0 in 0.460s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ea0d051-4000-409e-98da-acea7d447dab {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:44 devstack sudo[102446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ea0d051-4000-409e-98da-acea7d447dab
Nov 03 17:07:44 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:44 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19" returned: 0 in 0.382s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6482e5c9-ec60-4349-893c-22d65b4e995b]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:44 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ea0d051-4000-409e-98da-acea7d447dab" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25e5cf4-5485-471b-af0b-6a764780a5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea0d051-4000-409e-98da-acea7d447dab', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7889ec45-cde3-4983-954b-fd40795e94b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:44 devstack sudo[102451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f
Nov 03 17:07:44 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:44 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Volume volume-5ea0d051-4000-409e-98da-acea7d447dab (5ea0d051-4000-409e-98da-acea7d447dab): created successfully
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7889ec45-cde3-4983-954b-fd40795e94b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Flow 'volume_create_manager' (e0663112-ce29-4cf3-8cb8-705e36eced66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8b56220a-2bd7-4431-814a-d872e9c623fd tempest-VolumesListTestJSON-2012596892 None] Created volume successfully.
Nov 03 17:07:45 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f" returned: 0 in 0.392s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:07:45 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e8a12e-b0cc-4af8-929a-fc6efabee939]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:45 devstack sudo[102457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25
Nov 03 17:07:45 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:45 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" returned: 0 in 0.372s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:45 devstack sudo[102462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f
Nov 03 17:07:45 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:45 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f" returned: 0 in 0.356s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:45 devstack sudo[102467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f
Nov 03 17:07:45 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:46 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.55ca9f18-5f42-4ae0-8486-baf543940a2f" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 -F qcow2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:46 devstack sudo[102470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 -F qcow2
Nov 03 17:07:46 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:46 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 -F qcow2" returned: 0 in 0.341s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-55ca9f18-5f42-4ae0-8486-baf543940a2f" released by "_delete_snapshot" :: held 3.142s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" released by "delete_snapshot" :: held 3.168s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Created reservations ['4022390c-0c3b-4621-8e7c-4907abe1af6e', 'e364f9d0-fef4-424d-8b3b-8712bf0523de', 'b112a902-3b81-400b-9455-a6061d330445', '4c1331bb-0f62-4394-9e70-c921d91cdfa9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:07:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Delete snapshot completed successfully.
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-55ca9f18-5f42-4ae0-8486-baf543940a2f-delete_snapshot" released by "delete_snapshot" :: held 3.444s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-7546a344-3a49-4a0f-9140-eeb0aef65c19-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-7546a344-3a49-4a0f-9140-eeb0aef65c19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-quobyte-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-quobyte-7546a344-3a49-4a0f-9140-eeb0aef65c19" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Flow 'volume_create_manager' (cd9201a1-ab0d-4988-88e7-18803e1ca962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3806beb-dd09-4046-8909-7a8ace4284a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-7546a344-3a49-4a0f-9140-eeb0aef65c19" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Deleting offline snapshot 7546a344-3a49-4a0f-9140-eeb0aef65c19 of volume e4b2deb0-0866-434f-81a9-ad9b1ad40a25 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] snapshot_file for this snap is: volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3806beb-dd09-4046-8909-7a8ace4284a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-777386302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96396b77-8ac6-4c07-85b5-ff92cdb5ee21,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8f92fc682f0494b905ba289b5cc58dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:47Z,use_quota=True,user_id='44f1b3fdf35b4e089d455a24f284f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c64474-2e2d-4de3-b5b1-bb4ccc79b637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c64474-2e2d-4de3-b5b1-bb4ccc79b637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b5feb9-4f5d-4f6f-841e-52a0fedbd8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b5feb9-4f5d-4f6f-841e-52a0fedbd8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96396b77-8ac6-4c07-85b5-ff92cdb5ee21', 'volume_name': 'volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faca6228-2126-4601-9868-e2c2c389ad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faca6228-2126-4601-9868-e2c2c389ad19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5dfc73-4890-4522-8f17-d5c59fef60ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:47 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Volume 96396b77-8ac6-4c07-85b5-ff92cdb5ee21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21', 'volume_size': 1}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-777386302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96396b77-8ac6-4c07-85b5-ff92cdb5ee21,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8f92fc682f0494b905ba289b5cc58dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:47Z,use_quota=True,user_id='44f1b3fdf35b4e089d455a24f284f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Creating volume 96396b77-8ac6-4c07-85b5-ff92cdb5ee21 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:07:47 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f6c25b-872f-44ab-87db-2a0b9104d8d2]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:47 devstack sudo[102476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21 1073741824
Nov 03 17:07:47 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:47 devstack sudo[102477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19
Nov 03 17:07:47 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:47 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19" returned: 0 in 0.433s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:07:47 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21 1073741824" returned: 0 in 0.494s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3156e5bd-9122-4100-b801-1e95ef1ae7df]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:47 devstack sudo[102488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21
Nov 03 17:07:47 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:47 devstack sudo[102487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25
Nov 03 17:07:47 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:47 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21" returned: 0 in 0.315s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5dfc73-4890-4522-8f17-d5c59fef60ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f06173-9a44-4d12-bbce-274287dc79f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:47 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Volume volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21 (96396b77-8ac6-4c07-85b5-ff92cdb5ee21): created successfully
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f06173-9a44-4d12-bbce-274287dc79f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Flow 'volume_create_manager' (cd9201a1-ab0d-4988-88e7-18803e1ca962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:47 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" returned: 0 in 0.424s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-353b25d9-4c3b-459d-aab0-fcdeed35f962 tempest-VolumesListTestJSON-2012596892 None] Created volume successfully.
Nov 03 17:07:48 devstack sudo[102495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19
Nov 03 17:07:48 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:48 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19" returned: 0 in 0.366s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:48 devstack sudo[102500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19
Nov 03 17:07:48 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:48 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25.7546a344-3a49-4a0f-9140-eeb0aef65c19" returned: 0 in 0.250s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-7546a344-3a49-4a0f-9140-eeb0aef65c19" released by "_delete_snapshot" :: held 1.697s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" released by "delete_snapshot" :: held 1.777s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:48 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Created reservations ['f252835c-43c8-4ae1-8fa1-af3b65d0dc10', '13e481ce-8442-484a-a396-d72fa2779c21', '9efed12f-8ed1-49cc-afed-a4335da93c5d', '245f1407-4207-4479-ac19-edc4630bf56a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:07:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Delete snapshot completed successfully.
Nov 03 17:07:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-7546a344-3a49-4a0f-9140-eeb0aef65c19-delete_snapshot" released by "delete_snapshot" :: held 1.959s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Snapshots deleted, issuing volume delete {{(pid=87122) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 03 17:07:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-quobyte-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dadd1cc-147f-4325-9408-ae7025ccd4aa]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:48 devstack sudo[102503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25
Nov 03 17:07:48 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:49 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" returned: 0 in 0.431s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:49 devstack sudo[102508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25
Nov 03 17:07:49 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Flow 'volume_create_manager' (873270be-8e26-4cfd-8aa2-e24ad54ca755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b739d121-5062-4dcc-bd3f-77d5c317bfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b739d121-5062-4dcc-bd3f-77d5c317bfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1628735585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7650359b-14be-42a2-a4c5-10a2b4cf60ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8f92fc682f0494b905ba289b5cc58dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:49Z,use_quota=True,user_id='44f1b3fdf35b4e089d455a24f284f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9f7e7e-17fd-4e77-a01f-abd3152257d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9f7e7e-17fd-4e77-a01f-abd3152257d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619aed98-38e3-4699-bab4-50e3338881a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619aed98-38e3-4699-bab4-50e3338881a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7650359b-14be-42a2-a4c5-10a2b4cf60ef', 'volume_name': 'volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918bb631-033a-4395-8db4-fcd7b33e51f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918bb631-033a-4395-8db4-fcd7b33e51f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1c9e5f-255e-4cc4-ac45-ceb271954e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:49 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Volume 7650359b-14be-42a2-a4c5-10a2b4cf60ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef', 'volume_size': 1}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1628735585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7650359b-14be-42a2-a4c5-10a2b4cf60ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8f92fc682f0494b905ba289b5cc58dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:49Z,use_quota=True,user_id='44f1b3fdf35b4e089d455a24f284f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Creating volume 7650359b-14be-42a2-a4c5-10a2b4cf60ef {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:07:49 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:49 devstack sudo[102510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef 1073741824
Nov 03 17:07:49 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:49 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" returned: 0 in 0.277s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-e4b2deb0-0866-434f-81a9-ad9b1ad40a25" released by "delete_volume" :: held 0.781s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Created reservations ['1b387e86-ed65-49a0-8ef5-277d08a2a7a0', '7b719884-94b0-4a11-b4da-d68ee4edb1d9', 'e2a684d3-a893-47ee-898c-1d7937f8491e', 'dd4dc21a-db0b-448f-a36d-3fffad1c602e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:49 devstack sudo[102513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:07:49 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:49 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.260s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:49 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:07:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Deleted volume successfully.
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d76a05ca-7516-4021-9638-d3be98d055b0 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-e4b2deb0-0866-434f-81a9-ad9b1ad40a25-delete_volume" released by "delete_volume" :: held 6.746s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:50 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef 1073741824" returned: 0 in 0.545s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:50 devstack sudo[102520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef
Nov 03 17:07:50 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:50 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef" returned: 0 in 0.275s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1c9e5f-255e-4cc4-ac45-ceb271954e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235562ad-9440-4095-a387-eb8b89e7ba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:50 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Volume volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef (7650359b-14be-42a2-a4c5-10a2b4cf60ef): created successfully
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235562ad-9440-4095-a387-eb8b89e7ba49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Flow 'volume_create_manager' (873270be-8e26-4cfd-8aa2-e24ad54ca755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f60fad32-f968-4b3e-992c-09f1aa47d232 tempest-VolumesListTestJSON-2012596892 None] Created volume successfully.
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Flow 'volume_create_manager' (90044957-6482-447e-87f0-feeb5a63fc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28a69f6-86b7-4d61-8100-b8fb25f521e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28a69f6-86b7-4d61-8100-b8fb25f521e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1594358251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e43f0b-15a3-4e17-b842-f444952c84c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c34d94eab3a462c8459b06283c68ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:51Z,use_quota=True,user_id='3f040fc0f7d5417cb053611cf55c93eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9c3734-bff1-404e-b0da-d6bdaf984294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9c3734-bff1-404e-b0da-d6bdaf984294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01221bb-b9fa-4182-8f63-b1ccdfa9ee6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01221bb-b9fa-4182-8f63-b1ccdfa9ee6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2e43f0b-15a3-4e17-b842-f444952c84c4', 'volume_name': 'volume-c2e43f0b-15a3-4e17-b842-f444952c84c4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d42915-81c2-40e7-ad1c-74e36cb0d5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d42915-81c2-40e7-ad1c-74e36cb0d5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32445fe4-d071-4b25-996d-031b7ec8c5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:50 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Volume c2e43f0b-15a3-4e17-b842-f444952c84c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2e43f0b-15a3-4e17-b842-f444952c84c4', 'volume_size': 1}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1594358251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e43f0b-15a3-4e17-b842-f444952c84c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c34d94eab3a462c8459b06283c68ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:51Z,use_quota=True,user_id='3f040fc0f7d5417cb053611cf55c93eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Creating volume c2e43f0b-15a3-4e17-b842-f444952c84c4 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:07:50 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:07:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:50 devstack sudo[102524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 1073741824
Nov 03 17:07:50 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:51 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 1073741824" returned: 0 in 0.426s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:51 devstack sudo[102529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4
Nov 03 17:07:51 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:51 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32445fe4-d071-4b25-996d-031b7ec8c5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e43f0b-15a3-4e17-b842-f444952c84c4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b841fe96-4c31-453d-909d-40920c5f34dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:51 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Volume volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 (c2e43f0b-15a3-4e17-b842-f444952c84c4): created successfully
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b841fe96-4c31-453d-909d-40920c5f34dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Flow 'volume_create_manager' (90044957-6482-447e-87f0-feeb5a63fc24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-618f2331-a275-412f-9329-4984d092a3e7 tempest-VolumesDeleteCascade-1763369285 None] Created volume successfully.
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:51 devstack sudo[102532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:07:51 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] Creating offline snapshot 86846783-ef6f-4dce-a261-ac3f8808ea4e of volume c2e43f0b-15a3-4e17-b842-f444952c84c4 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea3d28d-aa99-4290-9007-e7d67c61fe49]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:52 devstack sudo[102534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4
Nov 03 17:07:52 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:52 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.264s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:07:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:07:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 29 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:07:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>, <Thread(Rabbit-heartbeat, started daemon 139029247180864)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:07:52 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4" returned: 0 in 0.396s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:52 devstack sudo[102540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e 1G
Nov 03 17:07:52 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:52 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e 1G" returned: 0 in 0.453s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:52 devstack sudo[102545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e
Nov 03 17:07:52 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:53 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:53 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e is being set with open permissions: ugo+rw
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:53 devstack sudo[102550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e
Nov 03 17:07:53 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:53 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e" returned: 0 in 0.289s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=90,cinder:UPDATE=112,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=114,cinder:INSERT=26,cinder:DELETE=11,cinder:SELECT=80 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:53 devstack sudo[102553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.info
Nov 03 17:07:53 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "cinder-7650359b-14be-42a2-a4c5-10a2b4cf60ef-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Lock "cinder-7650359b-14be-42a2-a4c5-10a2b4cf60ef-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "cinder-quobyte-7650359b-14be-42a2-a4c5-10a2b4cf60ef" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:53 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.info" returned: 0 in 0.315s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:53 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.info is being set with open permissions: ugo+rw
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Lock "cinder-quobyte-7650359b-14be-42a2-a4c5-10a2b4cf60ef" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:53 devstack sudo[102556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.info
Nov 03 17:07:53 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69f3a4d-c135-4efc-836b-d8335959bcb9]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:53 devstack sudo[102558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef
Nov 03 17:07:53 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:54 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.info" returned: 0 in 0.287s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e3bf41d8-2213-42ae-92ad-75ee2524da46 tempest-VolumesDeleteCascade-1763369285 None] Create snapshot completed successfully
Nov 03 17:07:54 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef" returned: 0 in 0.397s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:54 devstack sudo[102564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef
Nov 03 17:07:54 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:54 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7650359b-14be-42a2-a4c5-10a2b4cf60ef" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Lock "cinder-quobyte-7650359b-14be-42a2-a4c5-10a2b4cf60ef" released by "delete_volume" :: held 0.699s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Created reservations ['d187eed1-6a34-443d-9c69-c79ee53386ab', '6e0809e6-0b54-4579-a8ab-95e9c5016e34', 'c1b5bca2-860d-48fe-9871-bacad91dce5f', '9b645ddd-8403-4fda-b529-63b30da71f3f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:54 devstack sudo[102567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:07:54 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:54 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.283s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:07:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Deleted volume successfully.
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a44e05dc-81d0-4cf7-a6db-c1e4447d5925 tempest-VolumesListTestJSON-2012596892 None] Lock "cinder-7650359b-14be-42a2-a4c5-10a2b4cf60ef-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "cinder-96396b77-8ac6-4c07-85b5-ff92cdb5ee21-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Lock "cinder-96396b77-8ac6-4c07-85b5-ff92cdb5ee21-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "cinder-quobyte-96396b77-8ac6-4c07-85b5-ff92cdb5ee21" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Lock "cinder-quobyte-96396b77-8ac6-4c07-85b5-ff92cdb5ee21" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[46deb996-aabe-4d94-809d-a13b6e06eb51]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:55 devstack sudo[102570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21
Nov 03 17:07:55 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:55 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21" returned: 0 in 0.396s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:55 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21
Nov 03 17:07:55 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:55 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96396b77-8ac6-4c07-85b5-ff92cdb5ee21" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Lock "cinder-quobyte-96396b77-8ac6-4c07-85b5-ff92cdb5ee21" released by "delete_volume" :: held 0.715s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Flow 'volume_create_manager' (c876e90e-694c-45df-85cc-82d9eb05125e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25beb79d-8968-4f7f-bb9c-1db2fc67350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25beb79d-8968-4f7f-bb9c-1db2fc67350d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1294357275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed69d470-140d-40f8-a3e3-de3f355a1eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c34d94eab3a462c8459b06283c68ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=86846783-ef6f-4dce-a261-ac3f8808ea4e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:56Z,use_quota=True,user_id='3f040fc0f7d5417cb053611cf55c93eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828d2bfa-6ae0-43d1-8124-88faa9ec3a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828d2bfa-6ae0-43d1-8124-88faa9ec3a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eede6f57-410f-410e-81d5-0a3f39e1efd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eede6f57-410f-410e-81d5-0a3f39e1efd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed69d470-140d-40f8-a3e3-de3f355a1eba', 'volume_name': 'volume-ed69d470-140d-40f8-a3e3-de3f355a1eba', 'volume_size': 1, 'snapshot_id': '86846783-ef6f-4dce-a261-ac3f8808ea4e'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617823b6-6dbc-4109-91e9-54efd678ba5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617823b6-6dbc-4109-91e9-54efd678ba5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033ad13f-5433-4ac3-92ef-efaf3b2747a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:07:55 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Volume ed69d470-140d-40f8-a3e3-de3f355a1eba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed69d470-140d-40f8-a3e3-de3f355a1eba', 'volume_size': 1, 'snapshot_id': '86846783-ef6f-4dce-a261-ac3f8808ea4e'}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-quobyte-86846783-ef6f-4dce-a261-ac3f8808ea4e-ed69d470-140d-40f8-a3e3-de3f355a1eba" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-86846783-ef6f-4dce-a261-ac3f8808ea4e-ed69d470-140d-40f8-a3e3-de3f355a1eba" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Creating volume ed69d470-140d-40f8-a3e3-de3f355a1eba from snapshot 86846783-ef6f-4dce-a261-ac3f8808ea4e {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-quobyte-ed69d470-140d-40f8-a3e3-de3f355a1eba" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Created reservations ['aa3b74d8-1d12-434c-9eb1-f90ebc6ecc65', 'fdb5d1dd-9714-45ca-8fe4-a534670a0b53', '3d0273fb-35d5-4c7d-a60d-c2b922a648c1', '1b2ce4d3-d343-4302-a26c-4ffe1f25b869'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-ed69d470-140d-40f8-a3e3-de3f355a1eba" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] snapshot: 86846783-ef6f-4dce-a261-ac3f8808ea4e, volume: ed69d470-140d-40f8-a3e3-de3f355a1eba,  {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9277289d-5aa5-4eba-b65f-3ad43e316584]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:56 devstack sudo[102579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:07:56 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:56 devstack sudo[102578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e
Nov 03 17:07:56 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "cinder-5ea0d051-4000-409e-98da-acea7d447dab-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Lock "cinder-5ea0d051-4000-409e-98da-acea7d447dab-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "cinder-quobyte-5ea0d051-4000-409e-98da-acea7d447dab" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Lock "cinder-quobyte-5ea0d051-4000-409e-98da-acea7d447dab" acquired by "delete_volume" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[02df698f-17e2-4e73-8e2f-3f4d4d49ddad]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ea0d051-4000-409e-98da-acea7d447dab {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:56 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.324s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:07:56 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Deleted volume successfully.
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76fe59fc-778a-41db-88f8-1e80359b709a tempest-VolumesListTestJSON-2012596892 None] Lock "cinder-96396b77-8ac6-4c07-85b5-ff92cdb5ee21-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:56 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e" returned: 0 in 0.465s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2e43f0b-15a3-4e17-b842-f444952c84c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:07:56 devstack sudo[102582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ea0d051-4000-409e-98da-acea7d447dab
Nov 03 17:07:56 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[059e6476-e495-4986-a907-b3c7d238948f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:56 devstack sudo[102589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4
Nov 03 17:07:56 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:56 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ea0d051-4000-409e-98da-acea7d447dab" returned: 0 in 0.403s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ea0d051-4000-409e-98da-acea7d447dab {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:56 devstack sudo[102594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ea0d051-4000-409e-98da-acea7d447dab
Nov 03 17:07:56 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:56 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4" returned: 0 in 0.420s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Path /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 17:07:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:56 devstack sudo[102599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba
Nov 03 17:07:56 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:57 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-5ea0d051-4000-409e-98da-acea7d447dab" returned: 0 in 0.297s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Lock "cinder-quobyte-5ea0d051-4000-409e-98da-acea7d447dab" released by "delete_volume" :: held 0.752s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:07:57 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Created reservations ['cfe758c8-c6db-4a5e-8864-f071babc2452', '7764306d-f265-461e-89a3-4668b81841f4', '557ac185-b471-4bd8-8604-f9db1e53f5e2', '895a9519-8a8b-4299-a817-48f158b34f34'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:07:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:07:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:07:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:07:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:07:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:07:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:07:57 devstack sudo[102605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:07:57 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:07:57 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root
Nov 03 17:07:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.321s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:07:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:07:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Deleted volume successfully.
Nov 03 17:07:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c01bee1d-c47d-4102-9f5f-0b195417841d tempest-VolumesListTestJSON-2012596892 None] Lock "cinder-5ea0d051-4000-409e-98da-acea7d447dab-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:03 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba" returned: 0 in 6.931s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:03 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:08:03 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Converted 1024.00 MB image at 147.72 MB/s
Nov 03 17:08:03 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba is being set with open permissions: ugo+rw
Nov 03 17:08:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:03 devstack sudo[102617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba
Nov 03 17:08:03 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:04 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba" returned: 0 in 0.259s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-ed69d470-140d-40f8-a3e3-de3f355a1eba" released by "_copy_volume_from_snapshot" :: held 8.181s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-86846783-ef6f-4dce-a261-ac3f8808ea4e-ed69d470-140d-40f8-a3e3-de3f355a1eba" released by "_create_volume_from_snapshot" :: held 8.257s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.280s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033ad13f-5433-4ac3-92ef-efaf3b2747a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed69d470-140d-40f8-a3e3-de3f355a1eba', 'volume_size': 1, 'snapshot_id': '86846783-ef6f-4dce-a261-ac3f8808ea4e'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1a1d7a-7c6b-4ffd-91bc-484fcf31aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:04 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Volume volume-ed69d470-140d-40f8-a3e3-de3f355a1eba (ed69d470-140d-40f8-a3e3-de3f355a1eba): created successfully
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1a1d7a-7c6b-4ffd-91bc-484fcf31aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Flow 'volume_create_manager' (c876e90e-694c-45df-85cc-82d9eb05125e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:08:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-cd8ddc58-ce71-42ce-9490-7755b21da748 tempest-VolumesDeleteCascade-1763369285 None] Created volume successfully.
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-c2e43f0b-15a3-4e17-b842-f444952c84c4-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-c2e43f0b-15a3-4e17-b842-f444952c84c4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Performing cascade delete. {{(pid=87122) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-86846783-ef6f-4dce-a261-ac3f8808ea4e-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-86846783-ef6f-4dce-a261-ac3f8808ea4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-quobyte-c2e43f0b-15a3-4e17-b842-f444952c84c4" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-c2e43f0b-15a3-4e17-b842-f444952c84c4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-quobyte-86846783-ef6f-4dce-a261-ac3f8808ea4e" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-86846783-ef6f-4dce-a261-ac3f8808ea4e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Deleting offline snapshot 86846783-ef6f-4dce-a261-ac3f8808ea4e of volume c2e43f0b-15a3-4e17-b842-f444952c84c4 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] snapshot_file for this snap is: volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[82472947-5f83-4840-80ae-af5fea23ce9e]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:08:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:04 devstack sudo[102620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e
Nov 03 17:08:04 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:05 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e" returned: 0 in 0.452s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2e43f0b-15a3-4e17-b842-f444952c84c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:08:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[127f44f5-1440-4c0f-b027-d822611c42fc]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:08:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:05 devstack sudo[102626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4
Nov 03 17:08:05 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:05 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4" returned: 0 in 0.597s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:05 devstack sudo[102631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e
Nov 03 17:08:05 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:06 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e" returned: 0 in 0.362s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:06 devstack sudo[102636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e
Nov 03 17:08:06 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:06 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4.86846783-ef6f-4dce-a261-ac3f8808ea4e" returned: 0 in 0.288s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-86846783-ef6f-4dce-a261-ac3f8808ea4e" released by "_delete_snapshot" :: held 1.810s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-c2e43f0b-15a3-4e17-b842-f444952c84c4" released by "delete_snapshot" :: held 1.838s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:06 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Created reservations ['aebc1291-c89a-49de-ba49-c814cda5c2bb', '47e1ad41-6475-4958-909d-43ea8bec1835', 'ca4e88b2-208c-4ff1-ad08-90dbce43d209', 'd470a008-c09d-44fe-8ff6-ddf051eeba69'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:08:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Delete snapshot completed successfully.
Nov 03 17:08:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-86846783-ef6f-4dce-a261-ac3f8808ea4e-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Snapshots deleted, issuing volume delete {{(pid=87122) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 03 17:08:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-quobyte-c2e43f0b-15a3-4e17-b842-f444952c84c4" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:08:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-c2e43f0b-15a3-4e17-b842-f444952c84c4" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:08:06 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ef2c6b-409f-42aa-b520-d2266eea3aae]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:08:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:06 devstack sudo[102639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4
Nov 03 17:08:06 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:07 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4" returned: 0 in 0.476s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:07 devstack sudo[102644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4
Nov 03 17:08:07 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:07 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c2e43f0b-15a3-4e17-b842-f444952c84c4" returned: 0 in 0.249s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-c2e43f0b-15a3-4e17-b842-f444952c84c4" released by "delete_volume" :: held 0.822s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:07 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Created reservations ['a0f911f0-dd83-4fca-b139-855863be344d', '316cf70e-8587-4b92-82d0-fe934bea481f', 'e3027407-dc5d-4adf-bf2a-03781307cdac', 'bbbd5117-8d26-4c9c-9675-224db9768592'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:08:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:08:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:08:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:07 devstack sudo[102647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:08:07 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:08 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.307s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:08 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:08:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Deleted volume successfully.
Nov 03 17:08:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e2940b49-afd7-4484-9031-b192f01f4587 tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-c2e43f0b-15a3-4e17-b842-f444952c84c4-delete_volume" released by "delete_volume" :: held 3.435s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-ed69d470-140d-40f8-a3e3-de3f355a1eba-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:08:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-ed69d470-140d-40f8-a3e3-de3f355a1eba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:08:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "cinder-quobyte-ed69d470-140d-40f8-a3e3-de3f355a1eba" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:08:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-ed69d470-140d-40f8-a3e3-de3f355a1eba" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:08:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[be96a7b1-4ce0-410b-8215-70eda78efbfc]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:08:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:08 devstack sudo[102650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba
Nov 03 17:08:08 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:08 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba" returned: 0 in 0.462s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:08 devstack sudo[102655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba
Nov 03 17:08:08 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:08 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ed69d470-140d-40f8-a3e3-de3f355a1eba" returned: 0 in 0.284s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-quobyte-ed69d470-140d-40f8-a3e3-de3f355a1eba" released by "delete_volume" :: held 0.814s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:09 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Created reservations ['94ee43bd-ee6d-4d98-8f06-1d43aea160ea', 'fdb62f78-a7fd-48ad-a0be-e8c999f7a98f', '656b3368-48d3-47b6-aa0a-b4f3d6cc0bc4', 'd1263aff-4b5e-4f58-8db1-defc970f2294'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:08:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:08:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:08:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:09 devstack sudo[102658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:08:09 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:09 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.343s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:09 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:08:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Deleted volume successfully.
Nov 03 17:08:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f9868c40-a714-4b5b-a359-e4c207ca6e6c tempest-VolumesDeleteCascade-1763369285 None] Lock "cinder-ed69d470-140d-40f8-a3e3-de3f355a1eba-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Flow 'volume_create_manager' (c58f2e12-057f-4914-bd91-a065e9db05fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89324113-eaf7-4143-9ccc-50743c895f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89324113-eaf7-4143-9ccc-50743c895f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-369648923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bcadfe-d48b-4676-a8d6-fd85cf5dee21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e3d968ae1048459ccf0b8809230435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:18Z,use_quota=True,user_id='8b4b97fbd0e842ce98e4ea8c6ac96b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1be631d-13a6-40d1-9454-adbc93ebbdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1be631d-13a6-40d1-9454-adbc93ebbdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f37056-aeba-4f7c-b124-e03867daeffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f37056-aeba-4f7c-b124-e03867daeffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07bcadfe-d48b-4676-a8d6-fd85cf5dee21', 'volume_name': 'volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21', 'volume_size': 2}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a6de11-4d8b-4b8a-ab56-88b56880f960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a6de11-4d8b-4b8a-ab56-88b56880f960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29fd5d8-8f0c-43f5-a9ae-e7abcb87d1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:18 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Volume 07bcadfe-d48b-4676-a8d6-fd85cf5dee21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21', 'volume_size': 2}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-369648923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bcadfe-d48b-4676-a8d6-fd85cf5dee21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e3d968ae1048459ccf0b8809230435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:18Z,use_quota=True,user_id='8b4b97fbd0e842ce98e4ea8c6ac96b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Creating volume 07bcadfe-d48b-4676-a8d6-fd85cf5dee21 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:08:18 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:08:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21 2147483648 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:18 devstack sudo[102705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21 2147483648
Nov 03 17:08:18 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:19 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21 2147483648" returned: 0 in 0.518s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:19 devstack sudo[102710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21
Nov 03 17:08:19 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:19 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:08:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29fd5d8-8f0c-43f5-a9ae-e7abcb87d1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21', 'volume_size': 2}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bdc971-8b7c-4d61-b3a9-45bd223b88b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Volume volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21 (07bcadfe-d48b-4676-a8d6-fd85cf5dee21): created successfully
Nov 03 17:08:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bdc971-8b7c-4d61-b3a9-45bd223b88b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Flow 'volume_create_manager' (c58f2e12-057f-4914-bd91-a065e9db05fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:08:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f2aec2c0-7ab7-4cda-ab2c-f50aed1722ad tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Created volume successfully.
Nov 03 17:08:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Creating offline snapshot d623cdda-cdd8-4510-83f6-d4d72316914d of volume 07bcadfe-d48b-4676-a8d6-fd85cf5dee21 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:08:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be57eba-6357-4c00-997d-1dbc994a348c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:08:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:20 devstack sudo[102714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21
Nov 03 17:08:20 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:21 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21" returned: 0 in 0.397s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d 2G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:21 devstack sudo[102719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d 2G
Nov 03 17:08:21 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:21 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d 2G" returned: 0 in 0.437s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:21 devstack sudo[102725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d
Nov 03 17:08:21 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:21 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d" returned: 0 in 0.326s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:21 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d is being set with open permissions: ugo+rw
Nov 03 17:08:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:21 devstack sudo[102730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d
Nov 03 17:08:21 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:22 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d" returned: 0 in 0.265s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:22 devstack sudo[102733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.info
Nov 03 17:08:22 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:22 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.info" returned: 0 in 0.261s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:22 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.info is being set with open permissions: ugo+rw
Nov 03 17:08:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:22 devstack sudo[102736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.info
Nov 03 17:08:22 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:22 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.info" returned: 0 in 0.277s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3872db97-54e2-432f-8570-e0885f40a1df tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Create snapshot completed successfully
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Acquiring lock "cinder-d623cdda-cdd8-4510-83f6-d4d72316914d-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "cinder-d623cdda-cdd8-4510-83f6-d4d72316914d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Acquiring lock "cinder-quobyte-07bcadfe-d48b-4676-a8d6-fd85cf5dee21" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "cinder-quobyte-07bcadfe-d48b-4676-a8d6-fd85cf5dee21" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Acquiring lock "cinder-quobyte-d623cdda-cdd8-4510-83f6-d4d72316914d" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "cinder-quobyte-d623cdda-cdd8-4510-83f6-d4d72316914d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Deleting offline snapshot d623cdda-cdd8-4510-83f6-d4d72316914d of volume 07bcadfe-d48b-4676-a8d6-fd85cf5dee21 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] snapshot_file for this snap is: volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[927a7be6-f7e6-428c-9dd3-6d4244a8286a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:24 devstack sudo[102739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d
Nov 03 17:08:24 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:24 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d" returned: 0 in 0.452s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[063e69a1-194a-4174-b821-dec848e416fd]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:08:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:24 devstack sudo[102744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21
Nov 03 17:08:24 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:25 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21" returned: 0 in 0.404s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:25 devstack sudo[102749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d
Nov 03 17:08:25 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:25 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:25 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d
Nov 03 17:08:25 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:25 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21.d623cdda-cdd8-4510-83f6-d4d72316914d" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "cinder-quobyte-d623cdda-cdd8-4510-83f6-d4d72316914d" released by "_delete_snapshot" :: held 1.600s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "cinder-quobyte-07bcadfe-d48b-4676-a8d6-fd85cf5dee21" released by "delete_snapshot" :: held 1.629s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:25 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Created reservations ['df695e95-f546-4a2e-9ab8-9ee4def78ca0', '82911b72-0efe-4dc8-9657-1356102af53e', 'a0035fe5-432f-4140-bcf4-80bdcc2e3d5f', 'e7fb7de7-f272-4fe3-922c-80ea928d32f7'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:08:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Delete snapshot completed successfully.
Nov 03 17:08:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce3efadd-39bd-4f6b-9384-2b132d546a56 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "cinder-d623cdda-cdd8-4510-83f6-d4d72316914d-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Acquiring lock "cinder-07bcadfe-d48b-4676-a8d6-fd85cf5dee21-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:08:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "cinder-07bcadfe-d48b-4676-a8d6-fd85cf5dee21-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:08:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Acquiring lock "cinder-quobyte-07bcadfe-d48b-4676-a8d6-fd85cf5dee21" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:08:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "cinder-quobyte-07bcadfe-d48b-4676-a8d6-fd85cf5dee21" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:08:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faf3658-d6cf-4b46-887d-0c22c2b9292a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:08:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:26 devstack sudo[102757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21
Nov 03 17:08:26 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:26 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21" returned: 0 in 0.376s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:26 devstack sudo[102762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21
Nov 03 17:08:26 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:27 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-07bcadfe-d48b-4676-a8d6-fd85cf5dee21" returned: 0 in 0.284s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "cinder-quobyte-07bcadfe-d48b-4676-a8d6-fd85cf5dee21" released by "delete_volume" :: held 0.747s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:27 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Created reservations ['1c66109c-3a06-40e8-83b1-e9547d6031b3', '2a4445b7-cb05-4e92-a07f-a72ffa7d0bd9', 'f3da5c7c-8188-485b-828f-3e493d15fb21', '0a4da05e-cdb5-4f4e-aed8-3069567fa7d8'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:08:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:08:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:08:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:27 devstack sudo[102766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:08:27 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:27 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.332s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:27 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:08:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Deleted volume successfully.
Nov 03 17:08:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bdef184a-e60a-4fd8-9d7e-75b52e459f09 tempest-VolumesSnapshotNegativeTestJSON-1480964161 None] Lock "cinder-07bcadfe-d48b-4676-a8d6-fd85cf5dee21-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Flow 'volume_create_manager' (b43ae7e5-0f67-4cd9-80ea-97879787a03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b601307-cb6c-4b8f-8dc7-f1c93f12cdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b601307-cb6c-4b8f-8dc7-f1c93f12cdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1999879810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735d443cc92e492a8ec541148c2b13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:28Z,use_quota=True,user_id='96c7b78a40cd4ebfa3654ce62d9051ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ef41b87-72cc-46ea-8dc9-9347d519b03d),volume_type_id=8ef41b87-72cc-46ea-8dc9-9347d519b03d)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff44cbc-498e-492c-9b30-ddf83a23c17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff44cbc-498e-492c-9b30-ddf83a23c17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccea1231-9879-4f36-8588-422dd35e8278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccea1231-9879-4f36-8588-422dd35e8278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2', 'volume_name': 'volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9c144a-286b-47e6-9bf8-cc45e112ae43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9c144a-286b-47e6-9bf8-cc45e112ae43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24701e2-db74-4c71-bdb0-bcd496b2f925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:28 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Volume aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2', 'volume_size': 1}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1999879810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735d443cc92e492a8ec541148c2b13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:28Z,use_quota=True,user_id='96c7b78a40cd4ebfa3654ce62d9051ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ef41b87-72cc-46ea-8dc9-9347d519b03d),volume_type_id=8ef41b87-72cc-46ea-8dc9-9347d519b03d)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Creating volume aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:08:28 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:28 devstack sudo[102769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2 1073741824
Nov 03 17:08:28 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:08:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Flow 'volume_create_manager' (10e85e12-6c65-47c5-9c2b-821494323d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872477ec-c0dd-4853-9e87-ca21cec0b78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872477ec-c0dd-4853-9e87-ca21cec0b78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-932807181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6744c9a-a59c-4cdc-af3f-0a74eea8264d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735d443cc92e492a8ec541148c2b13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:29Z,use_quota=True,user_id='96c7b78a40cd4ebfa3654ce62d9051ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9be5149e-027c-49ca-a5c4-a7a90762361c),volume_type_id=9be5149e-027c-49ca-a5c4-a7a90762361c)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b1b1b3-c1b2-441d-97d1-a4c29f6efca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b1b1b3-c1b2-441d-97d1-a4c29f6efca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af43a4e3-41c6-4f21-90c1-45a0c75d9122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af43a4e3-41c6-4f21-90c1-45a0c75d9122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6744c9a-a59c-4cdc-af3f-0a74eea8264d', 'volume_name': 'volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0caa4b1b-74ce-410d-9370-19b655805942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0caa4b1b-74ce-410d-9370-19b655805942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1289f6-94c7-4517-afaa-9b0ba121d396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:29 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Volume a6744c9a-a59c-4cdc-af3f-0a74eea8264d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d', 'volume_size': 1}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:29 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2 1073741824" returned: 0 in 0.610s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:29 devstack sudo[102775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2
Nov 03 17:08:29 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:29 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.417s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-932807181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6744c9a-a59c-4cdc-af3f-0a74eea8264d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735d443cc92e492a8ec541148c2b13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:29Z,use_quota=True,user_id='96c7b78a40cd4ebfa3654ce62d9051ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9be5149e-027c-49ca-a5c4-a7a90762361c),volume_type_id=9be5149e-027c-49ca-a5c4-a7a90762361c)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Creating volume a6744c9a-a59c-4cdc-af3f-0a74eea8264d {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:08:29 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:29 devstack sudo[102778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d 1073741824
Nov 03 17:08:29 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24701e2-db74-4c71-bdb0-bcd496b2f925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2698e96c-05d3-4c55-89bc-485aa3472cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:29 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Volume volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2 (aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2): created successfully
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2698e96c-05d3-4c55-89bc-485aa3472cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Flow 'volume_create_manager' (b43ae7e5-0f67-4cd9-80ea-97879787a03a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:08:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-98f42036-3a55-48af-b1e9-749e92cb3a1f tempest-TestInstancesWithCinderVolumes-38229314 None] Created volume successfully.
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Flow 'volume_create_manager' (7a33e579-371b-4bdd-be40-ee8b77ca93ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b93f0ab-79fc-482b-97b3-05fb918f285d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b93f0ab-79fc-482b-97b3-05fb918f285d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1361567315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d4c4fc-d337-40f3-b7aa-43a8878b6ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735d443cc92e492a8ec541148c2b13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:30Z,use_quota=True,user_id='96c7b78a40cd4ebfa3654ce62d9051ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e589d50d-31bd-45ef-998f-714159ceb318),volume_type_id=e589d50d-31bd-45ef-998f-714159ceb318)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41bcd2d2-8ba3-4a3d-a881-2c552692538f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41bcd2d2-8ba3-4a3d-a881-2c552692538f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12505c8e-05bf-489d-8c50-04e3f5457e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:29 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 17:08:30 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d 1073741824" returned: 0 in 0.518s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:30 devstack sudo[102784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d
Nov 03 17:08:30 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12505c8e-05bf-489d-8c50-04e3f5457e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94d4c4fc-d337-40f3-b7aa-43a8878b6ed1', 'volume_name': 'volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1', 'volume_size': 1, 'image_id': '71b6a3ef-d239-4aab-b739-664c96ae69fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71b6a3ef-d239-4aab-b739-664c96ae69fa', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1793806291', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '735d443cc92e492a8ec541148c2b13a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71b6a3ef-d239-4aab-b739-664c96ae69fa', 'created_at': datetime.datetime(2026, 11, 3, 16, 8, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 8, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71b6a3ef-d239-4aab-b739-664c96ae69fa/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e723aa9d7c0>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6396dc6-ddf5-4add-8694-ebe1d261bd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6396dc6-ddf5-4add-8694-ebe1d261bd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac49cf5-9a76-46c6-956f-d5380a40a527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:30 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Volume 94d4c4fc-d337-40f3-b7aa-43a8878b6ed1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1', 'volume_size': 1, 'image_id': '71b6a3ef-d239-4aab-b739-664c96ae69fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71b6a3ef-d239-4aab-b739-664c96ae69fa', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1793806291', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '735d443cc92e492a8ec541148c2b13a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71b6a3ef-d239-4aab-b739-664c96ae69fa', 'created_at': datetime.datetime(2026, 11, 3, 16, 8, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 8, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71b6a3ef-d239-4aab-b739-664c96ae69fa/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e723aa9d7c0>}
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Trying to clone 94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 from image 71b6a3ef-d239-4aab-b739-664c96ae69fa at location (None, [{'url': 'file:///opt/stack/data/glance/images/71b6a3ef-d239-4aab-b739-664c96ae69fa', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 17:08:30 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d" returned: 0 in 0.297s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1289f6-94c7-4517-afaa-9b0ba121d396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df6b032-67c7-42a6-a6cb-3ccca62aa772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:30 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Volume volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d (a6744c9a-a59c-4cdc-af3f-0a74eea8264d): created successfully
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df6b032-67c7-42a6-a6cb-3ccca62aa772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Flow 'volume_create_manager' (10e85e12-6c65-47c5-9c2b-821494323d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:08:30 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fa4fd34c-3aba-474d-862a-bede3888cf76 tempest-TestInstancesWithCinderVolumes-38229314 None] Created volume successfully.
Nov 03 17:08:33 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD, size 20.69 MB, duration 3.24 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 17:08:33 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Image download 20.69 MB at 6.38 MB/s
Nov 03 17:08:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce7b3ba-c6f9-4c3d-83e4-696ae37a090a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:08:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:33 devstack sudo[102788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD
Nov 03 17:08:33 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:33 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:33 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Temporary image 71b6a3ef-d239-4aab-b739-664c96ae69fa is fetched for user 96c7b78a40cd4ebfa3654ce62d9051ae. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1382d1c9-bff2-4e0d-bbc5-76a016185a63]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:34 devstack sudo[102794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD
Nov 03 17:08:34 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:34 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1361567315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d4c4fc-d337-40f3-b7aa-43a8878b6ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735d443cc92e492a8ec541148c2b13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:30Z,use_quota=True,user_id='96c7b78a40cd4ebfa3654ce62d9051ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e589d50d-31bd-45ef-998f-714159ceb318),volume_type_id=e589d50d-31bd-45ef-998f-714159ceb318)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Creating volume 94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:08:34 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:34 devstack sudo[102799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 1073741824
Nov 03 17:08:34 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:34 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 1073741824" returned: 0 in 0.427s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:34 devstack sudo[102804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1
Nov 03 17:08:34 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:35 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1" returned: 0 in 0.321s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:08:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:35 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Attempting download of 71b6a3ef-d239-4aab-b739-664c96ae69fa ((None, [{'url': 'file:///opt/stack/data/glance/images/71b6a3ef-d239-4aab-b739-664c96ae69fa', 'metadata': {}}])) to volume 94d4c4fc-d337-40f3-b7aa-43a8878b6ed1. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 17:08:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cb6512-e2ac-4132-af4a-4ae93528313a]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:08:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71b6a3ef-d239-4aab-b739-664c96ae69fa_h61achgk {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:35 devstack sudo[102808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71b6a3ef-d239-4aab-b739-664c96ae69fa_h61achgk
Nov 03 17:08:35 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:35 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71b6a3ef-d239-4aab-b739-664c96ae69fa_h61achgk" returned: 0 in 0.322s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71b6a3ef-d239-4aab-b739-664c96ae69fa_h61achgk {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:35 devstack sudo[102812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71b6a3ef-d239-4aab-b739-664c96ae69fa_h61achgk
Nov 03 17:08:35 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:35 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71b6a3ef-d239-4aab-b739-664c96ae69fa_h61achgk" returned: 1 in 0.321s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71b6a3ef-d239-4aab-b739-664c96ae69fa_h61achgk' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:08:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[553bdaf6-475a-4699-8b63-26ad6b4de48a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:08:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:36 devstack sudo[102816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD
Nov 03 17:08:36 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:36 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:36 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] 71b6a3ef-d239-4aab-b739-664c96ae69fa was qcow2, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 17:08:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:36 devstack sudo[102822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1
Nov 03 17:08:36 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:38 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1" returned: 0 in 2.166s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:38 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71b6a3ef-d239-4aab-b739-664c96ae69fa_61dq2pjddevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:08:38 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Converted 112.00 MB image at 51.68 MB/s
Nov 03 17:08:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:38 devstack sudo[102830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 1G
Nov 03 17:08:38 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:38 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 1G" returned: 0 in 0.337s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:38 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Downloaded image 71b6a3ef-d239-4aab-b739-664c96ae69fa ((None, [{'url': 'file:///opt/stack/data/glance/images/71b6a3ef-d239-4aab-b739-664c96ae69fa', 'metadata': {}}])) to volume 94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 17:08:38 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Temporary image 71b6a3ef-d239-4aab-b739-664c96ae69fa for user 96c7b78a40cd4ebfa3654ce62d9051ae is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 17:08:38 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Marking volume 94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 17:08:38 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Copying metadata from image 71b6a3ef-d239-4aab-b739-664c96ae69fa to 94d4c4fc-d337-40f3-b7aa-43a8878b6ed1. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 17:08:38 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Creating volume glance metadata for volume 94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 backed by image 71b6a3ef-d239-4aab-b739-664c96ae69fa with: {'image_id': '71b6a3ef-d239-4aab-b739-664c96ae69fa', 'image_name': 'tempest-scenario-img--1793806291', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 17:08:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac49cf5-9a76-46c6-956f-d5380a40a527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1', 'volume_size': 1, 'image_id': '71b6a3ef-d239-4aab-b739-664c96ae69fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71b6a3ef-d239-4aab-b739-664c96ae69fa', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1793806291', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '735d443cc92e492a8ec541148c2b13a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71b6a3ef-d239-4aab-b739-664c96ae69fa', 'created_at': datetime.datetime(2026, 11, 3, 16, 8, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 8, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71b6a3ef-d239-4aab-b739-664c96ae69fa/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e723aa9d7c0>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85687f66-c49a-4739-b837-eeb3066bbee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:08:38 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Volume volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 (94d4c4fc-d337-40f3-b7aa-43a8878b6ed1): created successfully
Nov 03 17:08:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85687f66-c49a-4739-b837-eeb3066bbee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:08:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Flow 'volume_create_manager' (7a33e579-371b-4bdd-be40-ee8b77ca93ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:08:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4d0df76f-4512-4cfc-bec7-56d6a4f2e2ad tempest-TestInstancesWithCinderVolumes-38229314 None] Created volume successfully.
Nov 03 17:08:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-4cef5ac6-90e8-4cb8-af6e-3c2bc3c7a4e4 req-2c005567-7f66-4ded-9b20-fe42f2a61806 tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-4cef5ac6-90e8-4cb8-af6e-3c2bc3c7a4e4 req-2c005567-7f66-4ded-9b20-fe42f2a61806 tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-4cef5ac6-90e8-4cb8-af6e-3c2bc3c7a4e4 req-2c005567-7f66-4ded-9b20-fe42f2a61806 tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-4cef5ac6-90e8-4cb8-af6e-3c2bc3c7a4e4 req-2c005567-7f66-4ded-9b20-fe42f2a61806 tempest-TestInstancesWithCinderVolumes-38229314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4de56a80-3c67-4f64-9fbd-6e8ade58e0eb', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:08:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-4cef5ac6-90e8-4cb8-af6e-3c2bc3c7a4e4 req-2c005567-7f66-4ded-9b20-fe42f2a61806 tempest-TestInstancesWithCinderVolumes-38229314 None] attachment_update completed successfully.
Nov 03 17:08:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:08:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:08:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:08:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:08:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:08:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:08:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:08:51 devstack sudo[103331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:08:51 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:08:52 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root
Nov 03 17:08:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.399s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:08:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:08:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:08:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 29 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:08:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>, <Thread(Rabbit-heartbeat, started daemon 139029247180864)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:08:53 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=75,cinder:SELECT=75,cinder:INSERT=18,cinder:DELETE=9 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:08:53 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=65,cinder:UPDATE=85,cinder:INSERT=30,cinder:DELETE=4 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Flow 'volume_create_manager' (fba43a76-c1ae-4334-a122-fcfafdeee4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbae630-4e13-43a1-988b-aa6fa5db1561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbae630-4e13-43a1-988b-aa6fa5db1561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1789791025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b87c0e5-8f74-4353-88d9-165ec6494de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e44ba8bb775941028692b0cda4ae3b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:08Z,use_quota=True,user_id='142f15d5923b42159f056162740d6be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12ea16d-8ee0-4f43-918a-6eb299f64fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12ea16d-8ee0-4f43-918a-6eb299f64fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078d52ee-7c4c-4128-a004-6a002fff6ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078d52ee-7c4c-4128-a004-6a002fff6ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b87c0e5-8f74-4353-88d9-165ec6494de5', 'volume_name': 'volume-3b87c0e5-8f74-4353-88d9-165ec6494de5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f80656-5127-4d62-aa52-3f8b8488e2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f80656-5127-4d62-aa52-3f8b8488e2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e605b9c8-ec68-45b8-bbdc-94335d1fc101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:09:08 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Volume 3b87c0e5-8f74-4353-88d9-165ec6494de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b87c0e5-8f74-4353-88d9-165ec6494de5', 'volume_size': 1}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1789791025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b87c0e5-8f74-4353-88d9-165ec6494de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e44ba8bb775941028692b0cda4ae3b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:08Z,use_quota=True,user_id='142f15d5923b42159f056162740d6be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Creating volume 3b87c0e5-8f74-4353-88d9-165ec6494de5 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:09:08 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b87c0e5-8f74-4353-88d9-165ec6494de5 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:09:08 devstack sudo[103483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b87c0e5-8f74-4353-88d9-165ec6494de5 1073741824
Nov 03 17:09:08 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:09:08 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b87c0e5-8f74-4353-88d9-165ec6494de5 1073741824" returned: 0 in 0.469s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:09:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b87c0e5-8f74-4353-88d9-165ec6494de5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:09:08 devstack sudo[103488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b87c0e5-8f74-4353-88d9-165ec6494de5
Nov 03 17:09:08 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:09:09 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root
Nov 03 17:09:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b87c0e5-8f74-4353-88d9-165ec6494de5" returned: 0 in 0.305s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:09:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:09:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:09:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e605b9c8-ec68-45b8-bbdc-94335d1fc101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b87c0e5-8f74-4353-88d9-165ec6494de5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:09:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f47798-4657-4838-a9bf-3d3fb75a593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:09:09 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Volume volume-3b87c0e5-8f74-4353-88d9-165ec6494de5 (3b87c0e5-8f74-4353-88d9-165ec6494de5): created successfully
Nov 03 17:09:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f47798-4657-4838-a9bf-3d3fb75a593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:09:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Flow 'volume_create_manager' (fba43a76-c1ae-4334-a122-fcfafdeee4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:09:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c18b27c4-da86-4d0a-aff0-1c1bf1171e7d tempest-TestMinimumBasicScenario-1142655092 None] Created volume successfully.
Nov 03 17:09:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-3ac46781-3a4d-4c27-acd0-08aef37f6866 req-825d8c00-7679-4304-b2f1-636b60ff7529 tempest-TestMinimumBasicScenario-1142655092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:09:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-3ac46781-3a4d-4c27-acd0-08aef37f6866 req-825d8c00-7679-4304-b2f1-636b60ff7529 tempest-TestMinimumBasicScenario-1142655092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:09:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-3ac46781-3a4d-4c27-acd0-08aef37f6866 req-825d8c00-7679-4304-b2f1-636b60ff7529 tempest-TestMinimumBasicScenario-1142655092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:09:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-3ac46781-3a4d-4c27-acd0-08aef37f6866 req-825d8c00-7679-4304-b2f1-636b60ff7529 tempest-TestMinimumBasicScenario-1142655092 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-3b87c0e5-8f74-4353-88d9-165ec6494de5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '843a8ce0-4631-4065-a11f-8039d9757c8c', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:09:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-3ac46781-3a4d-4c27-acd0-08aef37f6866 req-825d8c00-7679-4304-b2f1-636b60ff7529 tempest-TestMinimumBasicScenario-1142655092 None] attachment_update completed successfully.
Nov 03 17:09:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a462a8bc-f42c-4383-9f3c-f78fee175bb7 req-598a0289-c09f-4a4b-a118-fd090a5c01b9 tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:09:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a462a8bc-f42c-4383-9f3c-f78fee175bb7 req-598a0289-c09f-4a4b-a118-fd090a5c01b9 tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:09:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a462a8bc-f42c-4383-9f3c-f78fee175bb7 req-598a0289-c09f-4a4b-a118-fd090a5c01b9 tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:09:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a462a8bc-f42c-4383-9f3c-f78fee175bb7 req-598a0289-c09f-4a4b-a118-fd090a5c01b9 tempest-TestInstancesWithCinderVolumes-38229314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b95a239-11ef-4979-889a-f5797e441741', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:09:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-a462a8bc-f42c-4383-9f3c-f78fee175bb7 req-598a0289-c09f-4a4b-a118-fd090a5c01b9 tempest-TestInstancesWithCinderVolumes-38229314 None] attachment_update completed successfully.
Nov 03 17:09:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-5c523139-89e2-4189-b259-ecedda5c819f req-531d2322-ffbb-4dfe-bc18-bc2c698d9cd1 tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:09:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-5c523139-89e2-4189-b259-ecedda5c819f req-531d2322-ffbb-4dfe-bc18-bc2c698d9cd1 tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:09:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-5c523139-89e2-4189-b259-ecedda5c819f req-531d2322-ffbb-4dfe-bc18-bc2c698d9cd1 tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:09:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-5c523139-89e2-4189-b259-ecedda5c819f req-531d2322-ffbb-4dfe-bc18-bc2c698d9cd1 tempest-TestInstancesWithCinderVolumes-38229314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fbd5f39-952b-4745-a032-26c92b24b7af', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:09:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-5c523139-89e2-4189-b259-ecedda5c819f req-531d2322-ffbb-4dfe-bc18-bc2c698d9cd1 tempest-TestInstancesWithCinderVolumes-38229314 None] attachment_update completed successfully.
Nov 03 17:09:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-a52d7bd0-99b3-48a8-b699-bab7afe6fae2 req-2e768bde-6f7e-469a-b67b-98fe96cc11d6 tempest-TestInstancesWithCinderVolumes-38229314 None] Terminate volume connection completed successfully.
Nov 03 17:09:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a52d7bd0-99b3-48a8-b699-bab7afe6fae2 req-2e768bde-6f7e-469a-b67b-98fe96cc11d6 tempest-TestInstancesWithCinderVolumes-38229314 None] Deleting attachment 6b95a239-11ef-4979-889a-f5797e441741. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:09:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "cinder-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:09:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "cinder-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:09:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "cinder-quobyte-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:09:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "cinder-quobyte-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:09:25 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acd5564-004c-4639-b2c7-6046823adde8]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:09:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:09:25 devstack sudo[103645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2
Nov 03 17:09:25 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:09:26 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2" returned: 0 in 0.406s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:09:26 devstack sudo[103651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2
Nov 03 17:09:26 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:09:26 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "cinder-quobyte-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2" released by "delete_volume" :: held 0.768s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:09:26 devstack cinder-volume[87122]: WARNING cinder.quota [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-986871639-1661138910 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-986871639-1661138910, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:09:26 devstack cinder-volume[87122]: WARNING cinder.quota [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-986871639-1661138910 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-986871639-1661138910, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Created reservations ['a0bf6d46-7779-48a9-a82f-aa590c7972de', '309305e9-96f9-4f97-bc9b-4fed51b75bc6', 'a48653fc-5b43-4114-a96f-6090e5883d7d', 'fbd87bb0-d7c9-41db-b59c-1247de954f6b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:09:26 devstack sudo[103654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:09:26 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:09:26 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.277s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:09:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Deleted volume successfully.
Nov 03 17:09:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04038431-344e-407a-af02-98fd9fa6119f tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "cinder-aa5bcc1f-d4e3-4f1a-9cef-3744423eb6d2-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:09:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-bcdcab7d-db18-469a-9295-a526bd889ed8 req-2f569032-c494-4465-b7fd-09f663134296 tempest-TestInstancesWithCinderVolumes-38229314 None] Terminate volume connection completed successfully.
Nov 03 17:09:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-bcdcab7d-db18-469a-9295-a526bd889ed8 req-2f569032-c494-4465-b7fd-09f663134296 tempest-TestInstancesWithCinderVolumes-38229314 None] Deleting attachment 9fbd5f39-952b-4745-a032-26c92b24b7af. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:09:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "cinder-a6744c9a-a59c-4cdc-af3f-0a74eea8264d-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:09:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "cinder-a6744c9a-a59c-4cdc-af3f-0a74eea8264d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:09:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "cinder-quobyte-a6744c9a-a59c-4cdc-af3f-0a74eea8264d" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:09:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "cinder-quobyte-a6744c9a-a59c-4cdc-af3f-0a74eea8264d" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:09:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4729f7f-c10c-4c69-8387-aa521b5f1dca]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:09:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:09:30 devstack sudo[103691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d
Nov 03 17:09:30 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:09:30 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root
Nov 03 17:09:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:09:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:09:30 devstack sudo[103697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d
Nov 03 17:09:30 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:09:31 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root
Nov 03 17:09:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a6744c9a-a59c-4cdc-af3f-0a74eea8264d" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:09:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "cinder-quobyte-a6744c9a-a59c-4cdc-af3f-0a74eea8264d" released by "delete_volume" :: held 0.752s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:09:31 devstack cinder-volume[87122]: WARNING cinder.quota [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-152887994-1698508467 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-152887994-1698508467, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:09:31 devstack cinder-volume[87122]: WARNING cinder.quota [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-152887994-1698508467 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-152887994-1698508467, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:09:31 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Created reservations ['73545eee-d88f-40f0-be0d-ee8c8a0c2ad8', '59a9ca02-3bd3-4314-845d-9f4b4ee6742d', 'f304ff9a-4cd7-4b3b-b80e-22453926f267', '0187a6da-7314-4534-b516-102f03ae91bd'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:09:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:09:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:09:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:09:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:09:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:09:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:09:31 devstack sudo[103700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:09:31 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:09:31 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root
Nov 03 17:09:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:09:31 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:09:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Deleted volume successfully.
Nov 03 17:09:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45c00173-d401-4d81-b45e-c5fb544d57ae tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "cinder-a6744c9a-a59c-4cdc-af3f-0a74eea8264d-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:09:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-d2dc1120-ceef-4f48-b442-51c1719d60c9 req-d9402760-64fb-4e20-95d0-87d31cafdd06 tempest-TestInstancesWithCinderVolumes-38229314 None] Terminate volume connection completed successfully.
Nov 03 17:09:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-d2dc1120-ceef-4f48-b442-51c1719d60c9 req-d9402760-64fb-4e20-95d0-87d31cafdd06 tempest-TestInstancesWithCinderVolumes-38229314 None] Deleting attachment 4de56a80-3c67-4f64-9fbd-6e8ade58e0eb. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:09:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "cinder-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:09:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "cinder-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:09:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "cinder-quobyte-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "cinder-quobyte-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a30a3a-d8bb-4cdb-9a53-123f668211b1]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:09:37 devstack sudo[104250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1
Nov 03 17:09:37 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:09:37 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1" returned: 0 in 0.370s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:09:37 devstack sudo[104255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1
Nov 03 17:09:37 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:09:37 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1" returned: 0 in 0.256s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "cinder-quobyte-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1" released by "delete_volume" :: held 0.695s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:09:37 devstack cinder-volume[87122]: WARNING cinder.quota [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-950868736-694078267 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-950868736-694078267, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:09:37 devstack cinder-volume[87122]: WARNING cinder.quota [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-950868736-694078267 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-950868736-694078267, it is now deprecated. Please use the default quota class for default quota.
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Created reservations ['ea02b9d2-5a8c-43c7-8d0e-8ac89cf5e7cc', '13e85132-d8e5-4e26-b29c-bb0f4d89e81a', '7ec1d9b8-3bda-4bdc-995d-71e2c5b81e5a', '35303232-10c0-4273-8c5a-4f2fb5c3af5c'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:09:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:09:37 devstack sudo[104258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:09:37 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:09:38 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root
Nov 03 17:09:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.277s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:09:38 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:09:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Deleted volume successfully.
Nov 03 17:09:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-53fc6c57-263c-4d03-a4d4-6d1c89759abd tempest-TestInstancesWithCinderVolumes-38229314 None] Lock "cinder-94d4c4fc-d337-40f3-b7aa-43a8878b6ed1-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:09:47 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=42,cinder:UPDATE=30,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:09:48 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=33,cinder:SELECT=37,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:09:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:09:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:09:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:09:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:09:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:09:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:09:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:09:51 devstack sudo[104281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:09:51 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:09:52 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root
Nov 03 17:09:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.286s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:09:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:09:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:09:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 29 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:09:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>, <Thread(Rabbit-heartbeat, started daemon 139029247180864)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:10:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-8b16f366-c88c-4218-91f4-2719b85da06e req-728da6a8-9e74-40eb-800b-1ca93da3f505 tempest-TestMinimumBasicScenario-1142655092 None] Terminate volume connection completed successfully.
Nov 03 17:10:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-8b16f366-c88c-4218-91f4-2719b85da06e req-728da6a8-9e74-40eb-800b-1ca93da3f505 tempest-TestMinimumBasicScenario-1142655092 None] Deleting attachment 843a8ce0-4631-4065-a11f-8039d9757c8c. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:10:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Acquiring lock "cinder-3b87c0e5-8f74-4353-88d9-165ec6494de5-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:10:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Lock "cinder-3b87c0e5-8f74-4353-88d9-165ec6494de5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:10:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Acquiring lock "cinder-quobyte-3b87c0e5-8f74-4353-88d9-165ec6494de5" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:10:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Lock "cinder-quobyte-3b87c0e5-8f74-4353-88d9-165ec6494de5" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:10:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faa0713-ae76-43d9-b869-628766081282]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:10:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b87c0e5-8f74-4353-88d9-165ec6494de5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:10:03 devstack sudo[104324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b87c0e5-8f74-4353-88d9-165ec6494de5
Nov 03 17:10:03 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:10:03 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root
Nov 03 17:10:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b87c0e5-8f74-4353-88d9-165ec6494de5" returned: 0 in 0.375s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:10:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b87c0e5-8f74-4353-88d9-165ec6494de5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:10:03 devstack sudo[104329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b87c0e5-8f74-4353-88d9-165ec6494de5
Nov 03 17:10:03 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:10:04 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root
Nov 03 17:10:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3b87c0e5-8f74-4353-88d9-165ec6494de5" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:10:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Lock "cinder-quobyte-3b87c0e5-8f74-4353-88d9-165ec6494de5" released by "delete_volume" :: held 0.711s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:10:04 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Created reservations ['e13d5489-0a6b-46d0-bd8e-b2bc7e48e4d0', '58fda235-2a42-42ba-b78d-bca1c185182f', '20544950-58f0-4365-bf23-17f0d4f977a4', '645f5e1d-15cb-45aa-a1d7-945358528458'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:10:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:10:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:10:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:10:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:10:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:10:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:10:04 devstack sudo[104332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:10:04 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:10:04 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root
Nov 03 17:10:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.302s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:10:04 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:10:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Deleted volume successfully.
Nov 03 17:10:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3eed1de4-1c17-4225-b61d-8aee9060fb07 tempest-TestMinimumBasicScenario-1142655092 None] Lock "cinder-3b87c0e5-8f74-4353-88d9-165ec6494de5-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:10:14 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=10 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Flow 'volume_create_manager' (6138843a-b090-40cf-b7e0-c78dc03bec5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459d0107-ce33-48ef-9768-5f55408e65c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459d0107-ce33-48ef-9768-5f55408e65c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1548035831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff643072-5eeb-4a84-a7a3-9c02fb5113ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51fd47ea1da4aaea5b1ae2a9321abba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:17Z,use_quota=True,user_id='77c91a46f566485595a9fc926c9c0f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8807cdcf-05c2-4551-be27-e2cf02b68365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8807cdcf-05c2-4551-be27-e2cf02b68365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e219e95d-403c-4754-a01a-1729c6665810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e219e95d-403c-4754-a01a-1729c6665810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff643072-5eeb-4a84-a7a3-9c02fb5113ad', 'volume_name': 'volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a99c9d-fe54-4d30-affa-8e1dda634583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a99c9d-fe54-4d30-affa-8e1dda634583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02bf897-2524-4f16-a76c-8abcba4c01fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:10:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Volume ff643072-5eeb-4a84-a7a3-9c02fb5113ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad', 'volume_size': 1}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1548035831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff643072-5eeb-4a84-a7a3-9c02fb5113ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51fd47ea1da4aaea5b1ae2a9321abba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:17Z,use_quota=True,user_id='77c91a46f566485595a9fc926c9c0f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Creating volume ff643072-5eeb-4a84-a7a3-9c02fb5113ad {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:10:17 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:10:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:10:17 devstack sudo[104403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad 1073741824
Nov 03 17:10:17 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:10:18 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root
Nov 03 17:10:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad 1073741824" returned: 0 in 0.580s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:10:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:10:18 devstack sudo[104411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad
Nov 03 17:10:18 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:10:18 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root
Nov 03 17:10:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad" returned: 0 in 0.293s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:10:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:10:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:10:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02bf897-2524-4f16-a76c-8abcba4c01fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:10:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcdad39-4449-4d3f-a895-ef9081621a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:10:18 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Volume volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad (ff643072-5eeb-4a84-a7a3-9c02fb5113ad): created successfully
Nov 03 17:10:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcdad39-4449-4d3f-a895-ef9081621a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:10:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Flow 'volume_create_manager' (6138843a-b090-40cf-b7e0-c78dc03bec5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:10:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-13d9eb46-6879-4ee7-a821-1c77d6d48546 tempest-TestStampPattern-324304433 None] Created volume successfully.
Nov 03 17:10:28 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:10:28 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:10:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-ec2ab813-e2e9-4f34-a4b9-8d466c135544 req-b3ed7170-d968-4e01-8477-9eaa0c246d69 tempest-TestStampPattern-324304433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:10:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-ec2ab813-e2e9-4f34-a4b9-8d466c135544 req-b3ed7170-d968-4e01-8477-9eaa0c246d69 tempest-TestStampPattern-324304433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:10:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-ec2ab813-e2e9-4f34-a4b9-8d466c135544 req-b3ed7170-d968-4e01-8477-9eaa0c246d69 tempest-TestStampPattern-324304433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:10:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-ec2ab813-e2e9-4f34-a4b9-8d466c135544 req-b3ed7170-d968-4e01-8477-9eaa0c246d69 tempest-TestStampPattern-324304433 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d750920-6e55-47f7-8e75-c12c8828ea1e', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:10:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-ec2ab813-e2e9-4f34-a4b9-8d466c135544 req-b3ed7170-d968-4e01-8477-9eaa0c246d69 tempest-TestStampPattern-324304433 None] attachment_update completed successfully.
Nov 03 17:10:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:10:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:10:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:10:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:10:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:10:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:10:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:10:51 devstack sudo[105065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:10:51 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:10:52 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root
Nov 03 17:10:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.358s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:10:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:10:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:10:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 29 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:10:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>, <Thread(Rabbit-heartbeat, started daemon 139029247180864)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:10:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-6c5c52a9-bb01-4bec-b4df-73434bd211ec req-5ad6ecfd-cb02-4adb-bb63-99451f0ef963 tempest-TestStampPattern-324304433 None] Terminate volume connection completed successfully.
Nov 03 17:10:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-6c5c52a9-bb01-4bec-b4df-73434bd211ec req-5ad6ecfd-cb02-4adb-bb63-99451f0ef963 tempest-TestStampPattern-324304433 None] Deleting attachment 8d750920-6e55-47f7-8e75-c12c8828ea1e. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:10:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:10:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:10:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] Creating offline snapshot 38c7b434-7146-49ce-8a66-d21e8bbeae1b of volume ff643072-5eeb-4a84-a7a3-9c02fb5113ad {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:10:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[428de570-1a1b-4144-b9e3-1db5c8f7f05a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:10:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:10:59 devstack sudo[105110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad
Nov 03 17:10:59 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:10:59 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root
Nov 03 17:10:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad" returned: 0 in 0.356s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:10:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:10:59 devstack sudo[105115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b 1G
Nov 03 17:10:59 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:10:59 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root
Nov 03 17:10:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b 1G" returned: 0 in 0.364s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:10:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:10:59 devstack sudo[105120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b
Nov 03 17:10:59 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:00 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b" returned: 0 in 0.307s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:00 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b is being set with open permissions: ugo+rw
Nov 03 17:11:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:00 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b
Nov 03 17:11:00 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:00 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b" returned: 0 in 0.236s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:00 devstack sudo[105128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.info
Nov 03 17:11:00 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:00 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.info" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:00 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.info is being set with open permissions: ugo+rw
Nov 03 17:11:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:00 devstack sudo[105131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.info
Nov 03 17:11:00 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:00 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.info" returned: 0 in 0.276s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:00 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1e0e4c98-51ec-4488-96e9-0967fc0ca5ef tempest-TestStampPattern-324304433 None] Create snapshot completed successfully
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Flow 'volume_create_manager' (a2f8f658-d512-4f2c-b818-1e84ac6d033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41083c24-2e6d-4e8b-95e0-3bb7c399f288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41083c24-2e6d-4e8b-95e0-3bb7c399f288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1399338699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=508508bd-52f1-48b3-8304-419f70eeb86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51fd47ea1da4aaea5b1ae2a9321abba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=38c7b434-7146-49ce-8a66-d21e8bbeae1b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:08Z,use_quota=True,user_id='77c91a46f566485595a9fc926c9c0f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985ba554-90eb-4820-b90d-6b1ed9879edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985ba554-90eb-4820-b90d-6b1ed9879edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf89339c-aa8b-4302-8972-f45f86092918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf89339c-aa8b-4302-8972-f45f86092918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '508508bd-52f1-48b3-8304-419f70eeb86f', 'volume_name': 'volume-508508bd-52f1-48b3-8304-419f70eeb86f', 'volume_size': 1, 'snapshot_id': '38c7b434-7146-49ce-8a66-d21e8bbeae1b'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c392cd6a-b88a-4986-8993-8cd927abc9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c392cd6a-b88a-4986-8993-8cd927abc9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89be7935-81ba-47a2-b997-61bcb154bbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:08 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Volume 508508bd-52f1-48b3-8304-419f70eeb86f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-508508bd-52f1-48b3-8304-419f70eeb86f', 'volume_size': 1, 'snapshot_id': '38c7b434-7146-49ce-8a66-d21e8bbeae1b'}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Acquiring lock "cinder-quobyte-38c7b434-7146-49ce-8a66-d21e8bbeae1b-508508bd-52f1-48b3-8304-419f70eeb86f" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Lock "cinder-quobyte-38c7b434-7146-49ce-8a66-d21e8bbeae1b-508508bd-52f1-48b3-8304-419f70eeb86f" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Creating volume 508508bd-52f1-48b3-8304-419f70eeb86f from snapshot 38c7b434-7146-49ce-8a66-d21e8bbeae1b {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Acquiring lock "cinder-quobyte-508508bd-52f1-48b3-8304-419f70eeb86f" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Lock "cinder-quobyte-508508bd-52f1-48b3-8304-419f70eeb86f" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] snapshot: 38c7b434-7146-49ce-8a66-d21e8bbeae1b, volume: 508508bd-52f1-48b3-8304-419f70eeb86f,  {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb62bae-571d-4bcf-a64c-384a62d51cd8]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:08 devstack sudo[105184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b
Nov 03 17:11:08 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:08 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b" returned: 0 in 0.402s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01dfec7-a134-43fc-8b5e-34f7257f73af]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:11:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:08 devstack sudo[105193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad
Nov 03 17:11:08 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:09 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad" returned: 0 in 0.440s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 17:11:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 17:11:09 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Path /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 17:11:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:09 devstack sudo[105202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f
Nov 03 17:11:09 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:18 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f" returned: 0 in 8.779s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:18 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad, size 1024.00 MB, duration 8.78 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:11:18 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Converted 1024.00 MB image at 116.63 MB/s
Nov 03 17:11:18 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f is being set with open permissions: ugo+rw
Nov 03 17:11:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:18 devstack sudo[105304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f
Nov 03 17:11:18 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:18 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:11:18 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:11:18 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f" returned: 0 in 0.548s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Lock "cinder-quobyte-508508bd-52f1-48b3-8304-419f70eeb86f" released by "_copy_volume_from_snapshot" :: held 10.276s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:11:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Lock "cinder-quobyte-38c7b434-7146-49ce-8a66-d21e8bbeae1b-508508bd-52f1-48b3-8304-419f70eeb86f" released by "_create_volume_from_snapshot" :: held 10.393s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:11:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.411s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89be7935-81ba-47a2-b997-61bcb154bbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-508508bd-52f1-48b3-8304-419f70eeb86f', 'volume_size': 1, 'snapshot_id': '38c7b434-7146-49ce-8a66-d21e8bbeae1b'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7854ba6a-1ef8-47e5-87b5-226f7771a5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:18 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Volume volume-508508bd-52f1-48b3-8304-419f70eeb86f (508508bd-52f1-48b3-8304-419f70eeb86f): created successfully
Nov 03 17:11:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7854ba6a-1ef8-47e5-87b5-226f7771a5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Flow 'volume_create_manager' (a2f8f658-d512-4f2c-b818-1e84ac6d033c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:11:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-06deda81-8037-4a67-ab01-e4cb238ebe41 tempest-TestStampPattern-324304433 None] Created volume successfully.
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Flow 'volume_create_manager' (b88ed4b0-1a2d-4ed6-a137-63d37c1c1788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba82578-ac04-4f2c-b1ab-8f2adcffab30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba82578-ac04-4f2c-b1ab-8f2adcffab30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-789441838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871552e0-7029-436d-ac80-73c73e51b37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6ebdae3f34d95993a24651aa2c656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:20Z,use_quota=True,user_id='f8a6a3506b6a4c94b4a0030970d34b72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04bf736-ad83-4393-a1a2-d14c43835704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04bf736-ad83-4393-a1a2-d14c43835704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a4e4b4-af78-49a3-ae05-a91dc464c4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a4e4b4-af78-49a3-ae05-a91dc464c4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871552e0-7029-436d-ac80-73c73e51b37b', 'volume_name': 'volume-871552e0-7029-436d-ac80-73c73e51b37b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4a9574-d4df-4e29-8c09-c0025528f55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4a9574-d4df-4e29-8c09-c0025528f55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33da0550-183d-4828-b393-24e484687b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Volume 871552e0-7029-436d-ac80-73c73e51b37b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871552e0-7029-436d-ac80-73c73e51b37b', 'volume_size': 1}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-789441838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871552e0-7029-436d-ac80-73c73e51b37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6ebdae3f34d95993a24651aa2c656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:20Z,use_quota=True,user_id='f8a6a3506b6a4c94b4a0030970d34b72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Creating volume 871552e0-7029-436d-ac80-73c73e51b37b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:11:19 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:11:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-871552e0-7029-436d-ac80-73c73e51b37b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:19 devstack sudo[105332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-871552e0-7029-436d-ac80-73c73e51b37b 1073741824
Nov 03 17:11:19 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:20 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-871552e0-7029-436d-ac80-73c73e51b37b 1073741824" returned: 0 in 0.541s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-871552e0-7029-436d-ac80-73c73e51b37b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:20 devstack sudo[105338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-871552e0-7029-436d-ac80-73c73e51b37b
Nov 03 17:11:20 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:20 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-871552e0-7029-436d-ac80-73c73e51b37b" returned: 0 in 0.284s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:11:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33da0550-183d-4828-b393-24e484687b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871552e0-7029-436d-ac80-73c73e51b37b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c687ecc6-d6f4-4f8b-918c-d7d57abab408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Volume volume-871552e0-7029-436d-ac80-73c73e51b37b (871552e0-7029-436d-ac80-73c73e51b37b): created successfully
Nov 03 17:11:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c687ecc6-d6f4-4f8b-918c-d7d57abab408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Flow 'volume_create_manager' (b88ed4b0-1a2d-4ed6-a137-63d37c1c1788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:11:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-772d9787-df38-4d0d-a699-19880948de30 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Created volume successfully.
Nov 03 17:11:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-107c94a0-957e-4a66-9615-17c8ccd6f15c req-8c0db5e9-3602-490f-bccb-855fec1348bc tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:11:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-107c94a0-957e-4a66-9615-17c8ccd6f15c req-8c0db5e9-3602-490f-bccb-855fec1348bc tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:11:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-107c94a0-957e-4a66-9615-17c8ccd6f15c req-8c0db5e9-3602-490f-bccb-855fec1348bc tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-107c94a0-957e-4a66-9615-17c8ccd6f15c req-8c0db5e9-3602-490f-bccb-855fec1348bc tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-871552e0-7029-436d-ac80-73c73e51b37b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d149696-9cc5-4694-99c3-e3b94f7597c8', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:11:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-107c94a0-957e-4a66-9615-17c8ccd6f15c req-8c0db5e9-3602-490f-bccb-855fec1348bc tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] attachment_update completed successfully.
Nov 03 17:11:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-fc5704a7-5ff0-4c4b-a856-a2f211767166 req-9a705a8b-a181-49bc-a2b4-8d5cabe13a5f tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Terminate volume connection completed successfully.
Nov 03 17:11:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-fc5704a7-5ff0-4c4b-a856-a2f211767166 req-9a705a8b-a181-49bc-a2b4-8d5cabe13a5f tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Deleting attachment 5d149696-9cc5-4694-99c3-e3b94f7597c8. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:11:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Acquiring lock "cinder-871552e0-7029-436d-ac80-73c73e51b37b-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:11:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Lock "cinder-871552e0-7029-436d-ac80-73c73e51b37b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:11:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Acquiring lock "cinder-quobyte-871552e0-7029-436d-ac80-73c73e51b37b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Lock "cinder-quobyte-871552e0-7029-436d-ac80-73c73e51b37b" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[772ecfad-3fa7-4da9-a973-e2000529d49f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-871552e0-7029-436d-ac80-73c73e51b37b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:27 devstack sudo[105797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-871552e0-7029-436d-ac80-73c73e51b37b
Nov 03 17:11:27 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:27 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-871552e0-7029-436d-ac80-73c73e51b37b" returned: 0 in 0.391s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-871552e0-7029-436d-ac80-73c73e51b37b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:27 devstack sudo[105802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-871552e0-7029-436d-ac80-73c73e51b37b
Nov 03 17:11:27 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:27 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-871552e0-7029-436d-ac80-73c73e51b37b" returned: 0 in 0.266s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Lock "cinder-quobyte-871552e0-7029-436d-ac80-73c73e51b37b" released by "delete_volume" :: held 0.719s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Created reservations ['ab61000c-e733-46d0-8185-125481f4ac9a', 'dd8609f7-930b-436f-9051-13bd12c9a310', 'ff5dc122-010a-4f29-ad69-74d0f2dae88e', 'cf7edc76-f077-4f4c-b384-cdf8ada306c8'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:27 devstack sudo[105805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:11:27 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:28 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:28 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:11:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Deleted volume successfully.
Nov 03 17:11:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3a6b65b-7896-4b9d-9bff-dccaaa0a1fd2 tempest-TestServerVolumeAttachScenarioOldVersion-488618244 None] Lock "cinder-871552e0-7029-436d-ac80-73c73e51b37b-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:11:37 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:INSERT=3,cinder:SELECT=12,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:11:38 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=20,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Flow 'volume_create_manager' (39407e1b-c9a4-458f-ab32-68646b044b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9690575c-e4ce-417f-9505-26ec2319bf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9690575c-e4ce-417f-9505-26ec2319bf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916a8887-cf37-4c6a-85ad-a5fea73dd8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88a744ed369464ab49a284b0c0117e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:47Z,use_quota=True,user_id='efe1bbfbb8b2410d93d94820d275437b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27359792-b375-4a48-8538-bc4f23999b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27359792-b375-4a48-8538-bc4f23999b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29613eb-8b7d-4899-91d2-0f8609b74a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29613eb-8b7d-4899-91d2-0f8609b74a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '916a8887-cf37-4c6a-85ad-a5fea73dd8f6', 'volume_name': 'volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6', 'volume_size': 1, 'image_id': '32350ab2-c2c6-40f2-97db-640b2000d350', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32350ab2-c2c6-40f2-97db-640b2000d350', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a61e8eabcf5489f1fadaf216c3ad2c18', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b88a744ed369464ab49a284b0c0117e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5658cd1c19d78c1538aeef29ccc36a0ac6e5bf1a1a182d20137ae6c12c6c8f1a91ea5cd032b978aeece64fb5a0760092f419bd7f3ae70e08cfb14e1dd6cb397f', 'id': '32350ab2-c2c6-40f2-97db-640b2000d350', 'created_at': datetime.datetime(2026, 11, 3, 16, 11, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 11, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32350ab2-c2c6-40f2-97db-640b2000d350/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e7244cb8f20>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf1974b-3b99-431e-871d-12fc673c1323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf1974b-3b99-431e-871d-12fc673c1323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a597937-d671-43c5-9f70-61db600b3489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:47 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Volume 916a8887-cf37-4c6a-85ad-a5fea73dd8f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6', 'volume_size': 1, 'image_id': '32350ab2-c2c6-40f2-97db-640b2000d350', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32350ab2-c2c6-40f2-97db-640b2000d350', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a61e8eabcf5489f1fadaf216c3ad2c18', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b88a744ed369464ab49a284b0c0117e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5658cd1c19d78c1538aeef29ccc36a0ac6e5bf1a1a182d20137ae6c12c6c8f1a91ea5cd032b978aeece64fb5a0760092f419bd7f3ae70e08cfb14e1dd6cb397f', 'id': '32350ab2-c2c6-40f2-97db-640b2000d350', 'created_at': datetime.datetime(2026, 11, 3, 16, 11, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 11, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32350ab2-c2c6-40f2-97db-640b2000d350/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e7244cb8f20>}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Trying to clone 916a8887-cf37-4c6a-85ad-a5fea73dd8f6 from image 32350ab2-c2c6-40f2-97db-640b2000d350 at location (None, [{'url': 'file:///opt/stack/data/glance/images/32350ab2-c2c6-40f2-97db-640b2000d350', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 17:11:47 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c318635-e266-4cbd-ae75-d0a3c6ac6344]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:11:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:47 devstack sudo[105859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD
Nov 03 17:11:47 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:48 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:48 devstack sudo[105863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD
Nov 03 17:11:48 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:48 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:11:48 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Temporary image 32350ab2-c2c6-40f2-97db-640b2000d350 is fetched for user efe1bbfbb8b2410d93d94820d275437b. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 17:11:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed953cd1-0751-413f-a140-44968fef2f90]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:11:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:48 devstack sudo[105868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD
Nov 03 17:11:48 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:48 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:49 devstack sudo[105872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD
Nov 03 17:11:49 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:49 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916a8887-cf37-4c6a-85ad-a5fea73dd8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88a744ed369464ab49a284b0c0117e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:47Z,use_quota=True,user_id='efe1bbfbb8b2410d93d94820d275437b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Creating volume 916a8887-cf37-4c6a-85ad-a5fea73dd8f6 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:11:49 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:49 devstack sudo[105877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6 1073741824
Nov 03 17:11:49 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:49 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6 1073741824" returned: 0 in 0.472s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:49 devstack sudo[105882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6
Nov 03 17:11:49 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:50 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6" returned: 0 in 0.300s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:11:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:50 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Attempting download of 32350ab2-c2c6-40f2-97db-640b2000d350 ((None, [{'url': 'file:///opt/stack/data/glance/images/32350ab2-c2c6-40f2-97db-640b2000d350', 'metadata': {}}])) to volume 916a8887-cf37-4c6a-85ad-a5fea73dd8f6. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 17:11:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[83694917-bbac-439c-8a70-37cfbcb0f5d9]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:11:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32350ab2-c2c6-40f2-97db-640b2000d350_r5wmsvu8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:50 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32350ab2-c2c6-40f2-97db-640b2000d350_r5wmsvu8
Nov 03 17:11:50 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:50 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32350ab2-c2c6-40f2-97db-640b2000d350_r5wmsvu8" returned: 0 in 0.370s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32350ab2-c2c6-40f2-97db-640b2000d350_r5wmsvu8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:50 devstack sudo[105889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32350ab2-c2c6-40f2-97db-640b2000d350_r5wmsvu8
Nov 03 17:11:50 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:50 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32350ab2-c2c6-40f2-97db-640b2000d350_r5wmsvu8" returned: 1 in 0.344s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32350ab2-c2c6-40f2-97db-640b2000d350_r5wmsvu8' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:11:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1194e382-959b-447f-8c53-63d8652cbd21]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:11:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:51 devstack sudo[105894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD
Nov 03 17:11:51 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:51 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:51 devstack sudo[105898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD
Nov 03 17:11:51 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:51 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:11:51 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] 32350ab2-c2c6-40f2-97db-640b2000d350 was raw, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 17:11:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:51 devstack sudo[105903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6
Nov 03 17:11:51 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:11:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:11:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:11:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:11:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:11:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:51 devstack sudo[105905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:11:51 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:52 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.294s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 29 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>, <Thread(Rabbit-heartbeat, started daemon 139029247180864)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:11:52 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6" returned: 0 in 0.525s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_32350ab2-c2c6-40f2-97db-640b2000d350_iflzw_xndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:11:52 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:52 devstack sudo[105912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6 1G
Nov 03 17:11:52 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:52 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6 1G" returned: 0 in 0.375s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Downloaded image 32350ab2-c2c6-40f2-97db-640b2000d350 ((None, [{'url': 'file:///opt/stack/data/glance/images/32350ab2-c2c6-40f2-97db-640b2000d350', 'metadata': {}}])) to volume 916a8887-cf37-4c6a-85ad-a5fea73dd8f6 successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Temporary image 32350ab2-c2c6-40f2-97db-640b2000d350 for user efe1bbfbb8b2410d93d94820d275437b is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Marking volume 916a8887-cf37-4c6a-85ad-a5fea73dd8f6 as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Copying metadata from image 32350ab2-c2c6-40f2-97db-640b2000d350 to 916a8887-cf37-4c6a-85ad-a5fea73dd8f6. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Creating volume glance metadata for volume 916a8887-cf37-4c6a-85ad-a5fea73dd8f6 backed by image 32350ab2-c2c6-40f2-97db-640b2000d350 with: {'image_id': '32350ab2-c2c6-40f2-97db-640b2000d350', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a61e8eabcf5489f1fadaf216c3ad2c18', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a597937-d671-43c5-9f70-61db600b3489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6', 'volume_size': 1, 'image_id': '32350ab2-c2c6-40f2-97db-640b2000d350', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32350ab2-c2c6-40f2-97db-640b2000d350', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a61e8eabcf5489f1fadaf216c3ad2c18', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b88a744ed369464ab49a284b0c0117e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5658cd1c19d78c1538aeef29ccc36a0ac6e5bf1a1a182d20137ae6c12c6c8f1a91ea5cd032b978aeece64fb5a0760092f419bd7f3ae70e08cfb14e1dd6cb397f', 'id': '32350ab2-c2c6-40f2-97db-640b2000d350', 'created_at': datetime.datetime(2026, 11, 3, 16, 11, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 11, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32350ab2-c2c6-40f2-97db-640b2000d350/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e7244cb8f20>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f352d15c-3467-40ca-b6eb-29cb75a0ac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:52 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Volume volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6 (916a8887-cf37-4c6a-85ad-a5fea73dd8f6): created successfully
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f352d15c-3467-40ca-b6eb-29cb75a0ac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Flow 'volume_create_manager' (39407e1b-c9a4-458f-ab32-68646b044b4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:11:52 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-48c13177-14c0-47f0-942f-07a8d44a1c2b tempest-VolumeImageDependencyTests-1813742170 None] Created volume successfully.
Nov 03 17:11:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Acquiring lock "cinder-916a8887-cf37-4c6a-85ad-a5fea73dd8f6-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:11:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Lock "cinder-916a8887-cf37-4c6a-85ad-a5fea73dd8f6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:11:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Acquiring lock "cinder-quobyte-916a8887-cf37-4c6a-85ad-a5fea73dd8f6" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:11:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Lock "cinder-quobyte-916a8887-cf37-4c6a-85ad-a5fea73dd8f6" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:11:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29324c5-c482-489b-89b6-2c3b17f7f943]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:11:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:53 devstack sudo[105917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6
Nov 03 17:11:53 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:54 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6" returned: 0 in 0.424s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:54 devstack sudo[105922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6
Nov 03 17:11:54 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:54 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-916a8887-cf37-4c6a-85ad-a5fea73dd8f6" returned: 0 in 0.286s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Lock "cinder-quobyte-916a8887-cf37-4c6a-85ad-a5fea73dd8f6" released by "delete_volume" :: held 0.761s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:11:54 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Created reservations ['0dd07dab-5691-4ede-ab05-d539efbc297a', 'f9ec28fd-df0f-489c-8d15-ff6e8fe58064', 'cd1ce0f6-a0c0-4352-83f1-4ca7402d59e5', 'f34eaf59-2743-4f41-9667-087a3d2be41c'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:11:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:11:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:11:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:11:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:11:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:54 devstack sudo[105926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:11:54 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:55 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.337s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:55 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:11:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Deleted volume successfully.
Nov 03 17:11:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-282eb33a-028c-4a94-8fc7-82e6fba8b906 tempest-VolumeImageDependencyTests-1813742170 None] Lock "cinder-916a8887-cf37-4c6a-85ad-a5fea73dd8f6-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Flow 'volume_create_manager' (7157eeac-c90d-4ad5-ae90-5e9ec06bbdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6df4bab-61b8-4053-a91d-5a94a861f0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6df4bab-61b8-4053-a91d-5a94a861f0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1492dd6a-5434-44b4-9d14-5241fe106e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7aed3abb81497d874cce04ba93c601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:58Z,use_quota=True,user_id='c72fb81329c64d4eaa9b92fe7995eb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2c6415-0e75-4034-b5f8-3dc62087c4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2c6415-0e75-4034-b5f8-3dc62087c4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1baa6275-920e-477a-ad0a-5bb3a044967b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1baa6275-920e-477a-ad0a-5bb3a044967b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1492dd6a-5434-44b4-9d14-5241fe106e5b', 'volume_name': 'volume-1492dd6a-5434-44b4-9d14-5241fe106e5b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96ddefd-d658-409d-8f01-f76591d6f0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96ddefd-d658-409d-8f01-f76591d6f0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd09352-4019-4f6d-b5d8-8a691996d146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Volume 1492dd6a-5434-44b4-9d14-5241fe106e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1492dd6a-5434-44b4-9d14-5241fe106e5b', 'volume_size': 1}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1492dd6a-5434-44b4-9d14-5241fe106e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7aed3abb81497d874cce04ba93c601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:58Z,use_quota=True,user_id='c72fb81329c64d4eaa9b92fe7995eb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Creating volume 1492dd6a-5434-44b4-9d14-5241fe106e5b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:11:58 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1492dd6a-5434-44b4-9d14-5241fe106e5b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:58 devstack sudo[105929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1492dd6a-5434-44b4-9d14-5241fe106e5b 1073741824
Nov 03 17:11:58 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:58 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1492dd6a-5434-44b4-9d14-5241fe106e5b 1073741824" returned: 0 in 0.440s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1492dd6a-5434-44b4-9d14-5241fe106e5b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:11:58 devstack sudo[105939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1492dd6a-5434-44b4-9d14-5241fe106e5b
Nov 03 17:11:58 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:11:59 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root
Nov 03 17:11:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1492dd6a-5434-44b4-9d14-5241fe106e5b" returned: 0 in 0.269s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:11:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:11:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:11:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd09352-4019-4f6d-b5d8-8a691996d146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1492dd6a-5434-44b4-9d14-5241fe106e5b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248aa15b-2f0a-403a-813f-68ba852f66bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:11:59 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Volume volume-1492dd6a-5434-44b4-9d14-5241fe106e5b (1492dd6a-5434-44b4-9d14-5241fe106e5b): created successfully
Nov 03 17:11:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248aa15b-2f0a-403a-813f-68ba852f66bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:11:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Flow 'volume_create_manager' (7157eeac-c90d-4ad5-ae90-5e9ec06bbdcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:11:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-08ad9f74-cb3e-42c8-b741-9557251fa585 tempest-CinderUnicodeTest-538128745 None] Created volume successfully.
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Flow 'volume_create_manager' (b0446c92-7ccb-45f8-81b7-3f95ef61c0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d0886f-2af6-4282-b054-fa0f58b9dc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d0886f-2af6-4282-b054-fa0f58b9dc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:12:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1534255252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1487bcb9-0117-4843-bde2-3466fd923f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7aed3abb81497d874cce04ba93c601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:00Z,use_quota=True,user_id='c72fb81329c64d4eaa9b92fe7995eb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f465c4b-ae7e-4c7f-ad92-6326dcea5250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f465c4b-ae7e-4c7f-ad92-6326dcea5250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10d86b6-ef40-483b-a5b9-d5e9d92e141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10d86b6-ef40-483b-a5b9-d5e9d92e141b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1487bcb9-0117-4843-bde2-3466fd923f07', 'volume_name': 'volume-1487bcb9-0117-4843-bde2-3466fd923f07', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9268cc28-a264-43e5-aba4-8cae81a29d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9268cc28-a264-43e5-aba4-8cae81a29d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4490b0d-b5a6-47f2-a046-f44edc9d89d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:00 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Volume 1487bcb9-0117-4843-bde2-3466fd923f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1487bcb9-0117-4843-bde2-3466fd923f07', 'volume_size': 1}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:12:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1534255252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1487bcb9-0117-4843-bde2-3466fd923f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7aed3abb81497d874cce04ba93c601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:00Z,use_quota=True,user_id='c72fb81329c64d4eaa9b92fe7995eb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Creating volume 1487bcb9-0117-4843-bde2-3466fd923f07 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:12:00 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-e7f7747b-a174-49f6-a5a0-acf02ba5d3d2 req-b4d67f9b-c209-4410-bd93-e1f0bc837751 tempest-TestStampPattern-324304433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:00 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07 1073741824
Nov 03 17:12:00 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:00 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07 1073741824" returned: 0 in 0.455s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:00 devstack sudo[105959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07
Nov 03 17:12:00 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:00 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07" returned: 0 in 0.320s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-e7f7747b-a174-49f6-a5a0-acf02ba5d3d2 req-b4d67f9b-c209-4410-bd93-e1f0bc837751 tempest-TestStampPattern-324304433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.807s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4490b0d-b5a6-47f2-a046-f44edc9d89d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1487bcb9-0117-4843-bde2-3466fd923f07', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1be41e9-a0f9-4ac5-b004-67f67b06878f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-e7f7747b-a174-49f6-a5a0-acf02ba5d3d2 req-b4d67f9b-c209-4410-bd93-e1f0bc837751 tempest-TestStampPattern-324304433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:01 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Volume volume-1487bcb9-0117-4843-bde2-3466fd923f07 (1487bcb9-0117-4843-bde2-3466fd923f07): created successfully
Nov 03 17:12:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1be41e9-a0f9-4ac5-b004-67f67b06878f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Flow 'volume_create_manager' (b0446c92-7ccb-45f8-81b7-3f95ef61c0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:12:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a3316a6b-265b-4248-a739-bed39d8df865 tempest-CinderUnicodeTest-538128745 None] Created volume successfully.
Nov 03 17:12:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-e7f7747b-a174-49f6-a5a0-acf02ba5d3d2 req-b4d67f9b-c209-4410-bd93-e1f0bc837751 tempest-TestStampPattern-324304433 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926', 'name': 'volume-508508bd-52f1-48b3-8304-419f70eeb86f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12c96584-e798-4c16-bc89-509669b2ebea', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 17:12:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-e7f7747b-a174-49f6-a5a0-acf02ba5d3d2 req-b4d67f9b-c209-4410-bd93-e1f0bc837751 tempest-TestStampPattern-324304433 None] attachment_update completed successfully.
Nov 03 17:12:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] Creating offline snapshot 99f874de-5c44-45e2-874e-f0731315621b of volume 1487bcb9-0117-4843-bde2-3466fd923f07 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:12:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[026dc7e0-8a15-463d-9c05-b8c2f913ee1a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:12:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:02 devstack sudo[106378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07
Nov 03 17:12:02 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:02 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07" returned: 0 in 0.395s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:02 devstack sudo[106383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b 1G
Nov 03 17:12:02 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:03 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b 1G" returned: 0 in 0.490s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1487bcb9-0117-4843-bde2-3466fd923f07 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:03 devstack sudo[106397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1487bcb9-0117-4843-bde2-3466fd923f07 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b
Nov 03 17:12:03 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:03 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1487bcb9-0117-4843-bde2-3466fd923f07 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b" returned: 0 in 0.307s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:03 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b is being set with open permissions: ugo+rw
Nov 03 17:12:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:03 devstack sudo[106408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b
Nov 03 17:12:03 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:03 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b" returned: 0 in 0.310s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:03 devstack sudo[106413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.info
Nov 03 17:12:03 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:04 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.info" returned: 0 in 0.286s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:04 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.info is being set with open permissions: ugo+rw
Nov 03 17:12:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:04 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.info
Nov 03 17:12:04 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:04 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.info" returned: 0 in 0.270s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-675fd00c-3a01-45e2-9248-cd0650baaf20 req-40c963ee-7eed-4f25-b06a-558fefbc894c tempest-TestStampPattern-324304433 None] Terminate volume connection completed successfully.
Nov 03 17:12:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-675fd00c-3a01-45e2-9248-cd0650baaf20 req-40c963ee-7eed-4f25-b06a-558fefbc894c tempest-TestStampPattern-324304433 None] Deleting attachment 12c96584-e798-4c16-bc89-509669b2ebea. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 17:12:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-330e1f3f-a844-40d8-8b78-70006edcff2d tempest-CinderUnicodeTest-538128745 None] Create snapshot completed successfully
Nov 03 17:12:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Acquiring lock "cinder-99f874de-5c44-45e2-874e-f0731315621b-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-99f874de-5c44-45e2-874e-f0731315621b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Acquiring lock "cinder-quobyte-1487bcb9-0117-4843-bde2-3466fd923f07" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-quobyte-1487bcb9-0117-4843-bde2-3466fd923f07" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Acquiring lock "cinder-quobyte-99f874de-5c44-45e2-874e-f0731315621b" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-quobyte-99f874de-5c44-45e2-874e-f0731315621b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Deleting offline snapshot 99f874de-5c44-45e2-874e-f0731315621b of volume 1487bcb9-0117-4843-bde2-3466fd923f07 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:12:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] snapshot_file for this snap is: volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:12:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[08259c94-9b0f-4cb9-99d6-5b8352bae711]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:12:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:05 devstack sudo[106446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b
Nov 03 17:12:05 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:06 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b" returned: 0 in 0.488s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1487bcb9-0117-4843-bde2-3466fd923f07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:12:06 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eee7f2-28f4-4cdb-986d-89f1e3953daf]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:12:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:06 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07
Nov 03 17:12:06 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:06 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07" returned: 0 in 0.598s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:06 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b
Nov 03 17:12:06 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:07 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b" returned: 0 in 0.584s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:07 devstack sudo[106486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b
Nov 03 17:12:07 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:07 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07.99f874de-5c44-45e2-874e-f0731315621b" returned: 0 in 0.317s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-quobyte-99f874de-5c44-45e2-874e-f0731315621b" released by "_delete_snapshot" :: held 2.144s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-quobyte-1487bcb9-0117-4843-bde2-3466fd923f07" released by "delete_snapshot" :: held 2.174s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:07 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Created reservations ['aad2cf4e-424e-4457-b721-1c06f5867f62', '05cee801-7e31-468d-b827-e4b1c6fa2bc3', '7cfd0933-29fa-4323-b3b6-bca17660c1bb', 'ae8b3532-aeab-41a2-ab08-1639d49249b5'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:12:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Delete snapshot completed successfully.
Nov 03 17:12:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-606e78c0-49de-4a0f-9209-ddef4585bd57 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-99f874de-5c44-45e2-874e-f0731315621b-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Acquiring lock "cinder-1487bcb9-0117-4843-bde2-3466fd923f07-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-1487bcb9-0117-4843-bde2-3466fd923f07-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Acquiring lock "cinder-quobyte-1487bcb9-0117-4843-bde2-3466fd923f07" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-quobyte-1487bcb9-0117-4843-bde2-3466fd923f07" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[32664a87-3b24-4ecd-9d5a-431ba581b741]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:12:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:09 devstack sudo[106492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07
Nov 03 17:12:09 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:09 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07" returned: 0 in 0.430s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:09 devstack sudo[106497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07
Nov 03 17:12:09 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:09 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1487bcb9-0117-4843-bde2-3466fd923f07" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-quobyte-1487bcb9-0117-4843-bde2-3466fd923f07" released by "delete_volume" :: held 0.799s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:10 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Created reservations ['8d0b4c5e-1c9a-4956-865f-d304e4c3e87b', '1ad6bb5d-5385-481c-99b8-e56121c3bf63', '4659a9da-817d-4dfc-a6aa-111d19bbcec9', '883ce84d-405c-4803-a594-78f26bbc845b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:12:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:12:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:12:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:10 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:12:10 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:11 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.260s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:11 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:12:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Deleted volume successfully.
Nov 03 17:12:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Acquiring lock "cinder-1492dd6a-5434-44b4-9d14-5241fe106e5b-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-1492dd6a-5434-44b4-9d14-5241fe106e5b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Acquiring lock "cinder-508508bd-52f1-48b3-8304-419f70eeb86f-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d69ec20f-f233-4a48-91c7-1de1ff3e5752 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-1487bcb9-0117-4843-bde2-3466fd923f07-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Lock "cinder-508508bd-52f1-48b3-8304-419f70eeb86f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Acquiring lock "cinder-quobyte-1492dd6a-5434-44b4-9d14-5241fe106e5b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-quobyte-1492dd6a-5434-44b4-9d14-5241fe106e5b" acquired by "delete_volume" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:12 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee58c1a-f970-4d2d-ae4a-987ece5f05e2]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:12:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1492dd6a-5434-44b4-9d14-5241fe106e5b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:12 devstack sudo[106510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1492dd6a-5434-44b4-9d14-5241fe106e5b
Nov 03 17:12:12 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:12 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1492dd6a-5434-44b4-9d14-5241fe106e5b" returned: 0 in 0.339s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1492dd6a-5434-44b4-9d14-5241fe106e5b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:12 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1492dd6a-5434-44b4-9d14-5241fe106e5b
Nov 03 17:12:12 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:13 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1492dd6a-5434-44b4-9d14-5241fe106e5b" returned: 0 in 0.237s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-quobyte-1492dd6a-5434-44b4-9d14-5241fe106e5b" released by "delete_volume" :: held 0.617s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Acquiring lock "cinder-quobyte-508508bd-52f1-48b3-8304-419f70eeb86f" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Lock "cinder-quobyte-508508bd-52f1-48b3-8304-419f70eeb86f" acquired by "delete_volume" :: waited 0.038s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a5ace3-89d5-45f7-8e0f-a3b5c37d7e58]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Created reservations ['f6132a24-690a-47b4-9028-f1aceb571c00', '60691bab-2822-4100-abee-ca680f359596', 'b53c39df-8759-426e-8153-2563c33ab687', '4b1fbfef-8766-4d6a-a9e0-ab833520c35d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:12:15 devstack sudo[106518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f
Nov 03 17:12:15 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:15 devstack sudo[106520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:12:15 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:15 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.246s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:12:15 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Deleted volume successfully.
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f" returned: 0 in 0.405s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c54c2e15-be25-40ca-a4e9-7b9ef1e61765 tempest-CinderUnicodeTest-538128745 None] Lock "cinder-1492dd6a-5434-44b4-9d14-5241fe106e5b-delete_volume" released by "delete_volume" :: held 3.903s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:15 devstack sudo[106526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f
Nov 03 17:12:15 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:15 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-508508bd-52f1-48b3-8304-419f70eeb86f" returned: 0 in 0.286s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Lock "cinder-quobyte-508508bd-52f1-48b3-8304-419f70eeb86f" released by "delete_volume" :: held 0.743s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Created reservations ['918eaf60-b550-4db6-94d2-d4ea6e87f01f', '72c0bc35-9659-492e-b287-f8401b3981cf', '59b36b34-7089-4625-bb5d-d64ced35eb3c', '1ba383ef-5183-42e3-b43e-cd75a126593e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:15 devstack sudo[106529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:12:15 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:16 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.254s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:12:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Deleted volume successfully.
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-451ba594-0081-4a1e-a849-accf7c5be7bd tempest-TestStampPattern-324304433 None] Lock "cinder-508508bd-52f1-48b3-8304-419f70eeb86f-delete_volume" released by "delete_volume" :: held 4.550s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Acquiring lock "cinder-38c7b434-7146-49ce-8a66-d21e8bbeae1b-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Lock "cinder-38c7b434-7146-49ce-8a66-d21e8bbeae1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Acquiring lock "cinder-quobyte-ff643072-5eeb-4a84-a7a3-9c02fb5113ad" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Lock "cinder-quobyte-ff643072-5eeb-4a84-a7a3-9c02fb5113ad" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Acquiring lock "cinder-quobyte-38c7b434-7146-49ce-8a66-d21e8bbeae1b" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Lock "cinder-quobyte-38c7b434-7146-49ce-8a66-d21e8bbeae1b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Deleting offline snapshot 38c7b434-7146-49ce-8a66-d21e8bbeae1b of volume ff643072-5eeb-4a84-a7a3-9c02fb5113ad {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] snapshot_file for this snap is: volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c830f7-1b96-4ae2-b4c1-7ad37bb1369c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:16 devstack sudo[106532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b
Nov 03 17:12:16 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:16 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b" returned: 0 in 0.361s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[da16de94-a4f7-4c2f-8d2a-f4647495d7cd]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:12:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:17 devstack sudo[106537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad
Nov 03 17:12:17 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:17 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad" returned: 0 in 0.559s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:17 devstack sudo[106542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b
Nov 03 17:12:17 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:17 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b" returned: 0 in 0.392s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:17 devstack sudo[106547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b
Nov 03 17:12:17 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:18 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad.38c7b434-7146-49ce-8a66-d21e8bbeae1b" returned: 0 in 0.265s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Lock "cinder-quobyte-38c7b434-7146-49ce-8a66-d21e8bbeae1b" released by "_delete_snapshot" :: held 1.706s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Lock "cinder-quobyte-ff643072-5eeb-4a84-a7a3-9c02fb5113ad" released by "delete_snapshot" :: held 1.732s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:18 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Created reservations ['a2d1c60a-3538-4a11-a869-6743e780400f', '31767d7f-4162-4f3b-b5c9-9eab40ab6f7a', 'c99f5e80-6bc8-4d8f-9da5-d4793d7cf38a', '68991e24-7ec1-488f-9c3c-ccac582dc5bb'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:12:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Delete snapshot completed successfully.
Nov 03 17:12:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3de2962-c85a-48ed-bd08-da426715ca77 tempest-TestStampPattern-324304433 None] Lock "cinder-38c7b434-7146-49ce-8a66-d21e8bbeae1b-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Acquiring lock "cinder-ff643072-5eeb-4a84-a7a3-9c02fb5113ad-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Lock "cinder-ff643072-5eeb-4a84-a7a3-9c02fb5113ad-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Acquiring lock "cinder-quobyte-ff643072-5eeb-4a84-a7a3-9c02fb5113ad" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Lock "cinder-quobyte-ff643072-5eeb-4a84-a7a3-9c02fb5113ad" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[896cd061-d2a9-4139-ae5c-eaf8abe593ac]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:12:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:22 devstack sudo[106614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad
Nov 03 17:12:22 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:22 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad" returned: 0 in 0.400s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:23 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad
Nov 03 17:12:23 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:23 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff643072-5eeb-4a84-a7a3-9c02fb5113ad" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Lock "cinder-quobyte-ff643072-5eeb-4a84-a7a3-9c02fb5113ad" released by "delete_volume" :: held 0.747s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:23 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Created reservations ['80e2de5c-9f81-45ea-a79d-5718f887b320', 'e793c732-1698-49d0-b33e-167bf1b3a364', 'bcbd3c5e-f16b-483f-8b6c-06d6bfcfb63f', 'edb3684f-7bd6-4214-b5e4-ece0c8894866'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:12:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:12:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:12:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:23 devstack sudo[106622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:12:23 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:23 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.283s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:23 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:12:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Deleted volume successfully.
Nov 03 17:12:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4d80fdec-ad22-40df-a5f0-6e56f00d3b43 tempest-TestStampPattern-324304433 None] Lock "cinder-ff643072-5eeb-4a84-a7a3-9c02fb5113ad-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:33 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=56,cinder:INSERT=24,cinder:UPDATE=63,cinder:DELETE=6 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:12:33 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=62,cinder:UPDATE=67,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Flow 'volume_create_manager' (c62b26ec-a0f4-41e4-add4-7e8fcb86840a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc8406b-acd0-4c33-afe1-040c393da244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc8406b-acd0-4c33-afe1-040c393da244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200141495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712a22f7-1df9-4677-95de-8c50c4cbb6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0defc6831a5044d19b6a6235dd9a5328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:38Z,use_quota=True,user_id='4283d42e9c02405ba2e82da51a564705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf99993c-fd02-477a-8da7-ae4b1a99dd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf99993c-fd02-477a-8da7-ae4b1a99dd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a20fcb-3061-429c-89d0-10529f33385b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a20fcb-3061-429c-89d0-10529f33385b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '712a22f7-1df9-4677-95de-8c50c4cbb6e1', 'volume_name': 'volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7872d544-4571-4843-8f7e-a5383fa8fdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7872d544-4571-4843-8f7e-a5383fa8fdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4326a1d9-8cf2-48c5-9080-2904bcde3075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:37 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Volume 712a22f7-1df9-4677-95de-8c50c4cbb6e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1', 'volume_size': 1}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200141495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712a22f7-1df9-4677-95de-8c50c4cbb6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0defc6831a5044d19b6a6235dd9a5328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:38Z,use_quota=True,user_id='4283d42e9c02405ba2e82da51a564705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Creating volume 712a22f7-1df9-4677-95de-8c50c4cbb6e1 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:12:37 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:12:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:37 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1 1073741824
Nov 03 17:12:37 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:38 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1 1073741824" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:38 devstack sudo[106640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1
Nov 03 17:12:38 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:38 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1" returned: 0 in 0.260s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:12:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4326a1d9-8cf2-48c5-9080-2904bcde3075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce15f7b-6b0d-4474-baa4-2c8facb41dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:38 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Volume volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1 (712a22f7-1df9-4677-95de-8c50c4cbb6e1): created successfully
Nov 03 17:12:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce15f7b-6b0d-4474-baa4-2c8facb41dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Flow 'volume_create_manager' (c62b26ec-a0f4-41e4-add4-7e8fcb86840a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:12:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c4509245-e12b-4d9c-869b-4753de87f12f tempest-ProjectReaderTests-1437533115 None] Created volume successfully.
Nov 03 17:12:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Acquiring lock "cinder-712a22f7-1df9-4677-95de-8c50c4cbb6e1-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Lock "cinder-712a22f7-1df9-4677-95de-8c50c4cbb6e1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Acquiring lock "cinder-quobyte-712a22f7-1df9-4677-95de-8c50c4cbb6e1" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Lock "cinder-quobyte-712a22f7-1df9-4677-95de-8c50c4cbb6e1" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:39 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f7f7fb-55be-4fe8-aead-81152714ae44]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:12:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:39 devstack sudo[106643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1
Nov 03 17:12:39 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:39 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1" returned: 0 in 0.410s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:39 devstack sudo[106649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1
Nov 03 17:12:39 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:39 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-712a22f7-1df9-4677-95de-8c50c4cbb6e1" returned: 0 in 0.257s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Lock "cinder-quobyte-712a22f7-1df9-4677-95de-8c50c4cbb6e1" released by "delete_volume" :: held 0.711s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:39 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Created reservations ['d42fd543-aee3-4229-bc8e-a04bdd8133e6', '438d90dd-0c70-4064-988a-8104f51d81a6', '8a82b91f-f7ca-4bee-8c83-d505ab7ff635', 'bde9f7b8-e203-4b1b-8ebb-f7d59e92ae95'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:40 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:12:40 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:40 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.272s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:12:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Deleted volume successfully.
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-77991b35-80e5-473b-b8f8-5deaa47253a3 tempest-ProjectReaderTests-1437533115 None] Lock "cinder-712a22f7-1df9-4677-95de-8c50c4cbb6e1-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Flow 'volume_create_manager' (a72c656f-e4ee-4e78-ae58-9ec5bd4088b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcd7215-a020-4a03-a43a-84660925c08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcd7215-a020-4a03-a43a-84660925c08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879293648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ce1448-03b0-4853-a202-033e65dbcef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0defc6831a5044d19b6a6235dd9a5328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:41Z,use_quota=True,user_id='4283d42e9c02405ba2e82da51a564705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bb7f53-40f2-4eb4-9152-f370f93b8829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bb7f53-40f2-4eb4-9152-f370f93b8829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18ca296-a8e5-463f-ae1e-fa2d3b44c8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18ca296-a8e5-463f-ae1e-fa2d3b44c8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ce1448-03b0-4853-a202-033e65dbcef3', 'volume_name': 'volume-73ce1448-03b0-4853-a202-033e65dbcef3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59203695-c62b-4c4a-99ad-80da5ff7d715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59203695-c62b-4c4a-99ad-80da5ff7d715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa0ff15-af72-43eb-b549-13bbc6facfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Volume 73ce1448-03b0-4853-a202-033e65dbcef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ce1448-03b0-4853-a202-033e65dbcef3', 'volume_size': 1}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879293648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ce1448-03b0-4853-a202-033e65dbcef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0defc6831a5044d19b6a6235dd9a5328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:41Z,use_quota=True,user_id='4283d42e9c02405ba2e82da51a564705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Creating volume 73ce1448-03b0-4853-a202-033e65dbcef3 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:12:40 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:12:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-73ce1448-03b0-4853-a202-033e65dbcef3 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:40 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-73ce1448-03b0-4853-a202-033e65dbcef3 1073741824
Nov 03 17:12:40 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:41 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-73ce1448-03b0-4853-a202-033e65dbcef3 1073741824" returned: 0 in 0.484s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-73ce1448-03b0-4853-a202-033e65dbcef3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:41 devstack sudo[106662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-73ce1448-03b0-4853-a202-033e65dbcef3
Nov 03 17:12:41 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:41 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-73ce1448-03b0-4853-a202-033e65dbcef3" returned: 0 in 0.259s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:12:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa0ff15-af72-43eb-b549-13bbc6facfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ce1448-03b0-4853-a202-033e65dbcef3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4890c4ad-d29f-4ea0-bc5b-1777a0c41c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:12:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Volume volume-73ce1448-03b0-4853-a202-033e65dbcef3 (73ce1448-03b0-4853-a202-033e65dbcef3): created successfully
Nov 03 17:12:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4890c4ad-d29f-4ea0-bc5b-1777a0c41c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:12:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Flow 'volume_create_manager' (a72c656f-e4ee-4e78-ae58-9ec5bd4088b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:12:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-67ab49e6-70de-4709-a20b-fa41592d704d tempest-ProjectReaderTests-1437533115 None] Created volume successfully.
Nov 03 17:12:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Acquiring lock "cinder-73ce1448-03b0-4853-a202-033e65dbcef3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Lock "cinder-73ce1448-03b0-4853-a202-033e65dbcef3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Acquiring lock "cinder-quobyte-73ce1448-03b0-4853-a202-033e65dbcef3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Lock "cinder-quobyte-73ce1448-03b0-4853-a202-033e65dbcef3" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[33485547-4351-4031-957a-2ad186c43f5d]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-73ce1448-03b0-4853-a202-033e65dbcef3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:43 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-73ce1448-03b0-4853-a202-033e65dbcef3
Nov 03 17:12:43 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:43 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-73ce1448-03b0-4853-a202-033e65dbcef3" returned: 0 in 0.381s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-73ce1448-03b0-4853-a202-033e65dbcef3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:43 devstack sudo[106672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-73ce1448-03b0-4853-a202-033e65dbcef3
Nov 03 17:12:43 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:43 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-73ce1448-03b0-4853-a202-033e65dbcef3" returned: 0 in 0.269s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Lock "cinder-quobyte-73ce1448-03b0-4853-a202-033e65dbcef3" released by "delete_volume" :: held 0.698s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Created reservations ['362c9467-ac0b-4c1d-868e-fcd3b2a7bde8', 'c8d61ae6-7652-476a-8503-3df88dcfd3d0', '4fcaeaa0-2630-484e-a59d-dd7b4db79c0b', 'bde06955-5388-4d5f-8d9b-8afc63c18aec'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:43 devstack sudo[106675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:12:43 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:44 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:44 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:12:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Deleted volume successfully.
Nov 03 17:12:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-452f3199-45c9-411b-a7a6-bb01936348d0 tempest-ProjectReaderTests-1437533115 None] Lock "cinder-73ce1448-03b0-4853-a202-033e65dbcef3-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:12:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:12:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:12:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:12:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:12:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:12:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:12:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:12:51 devstack sudo[106679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:12:51 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:12:52 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root
Nov 03 17:12:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:12:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:12:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:12:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 29 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:12:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>, <Thread(Rabbit-heartbeat, started daemon 139029247180864)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:12:53 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=20,cinder:SELECT=13,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:12:54 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=15,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Flow 'volume_create_manager' (20c1ac38-cb0d-4d5c-90ad-d77329b42507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a552443c-4e90-4862-8740-8309873ce879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a552443c-4e90-4862-8740-8309873ce879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-419750395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7953bca-145c-41e8-9408-384a22e75bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf907edc44a2434f8c3f5ea098b8dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:16Z,use_quota=True,user_id='ef61642c931d4569b30fb9f4c46c8186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11431c7f-14d3-4007-a30a-eadf2ed6bae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11431c7f-14d3-4007-a30a-eadf2ed6bae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9463365c-14c9-4eea-bcc7-57f5b6f321a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9463365c-14c9-4eea-bcc7-57f5b6f321a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7953bca-145c-41e8-9408-384a22e75bf2', 'volume_name': 'volume-d7953bca-145c-41e8-9408-384a22e75bf2', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13589cf-ec7a-4cc3-85e2-37a818199ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13589cf-ec7a-4cc3-85e2-37a818199ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038056b4-82c8-4152-be4c-2097483ea6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Volume d7953bca-145c-41e8-9408-384a22e75bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7953bca-145c-41e8-9408-384a22e75bf2', 'volume_size': 1}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-419750395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7953bca-145c-41e8-9408-384a22e75bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf907edc44a2434f8c3f5ea098b8dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:16Z,use_quota=True,user_id='ef61642c931d4569b30fb9f4c46c8186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Creating volume d7953bca-145c-41e8-9408-384a22e75bf2 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:13:16 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:16 devstack sudo[106690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2 1073741824
Nov 03 17:13:16 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:16 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2 1073741824" returned: 0 in 0.392s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:16 devstack sudo[106695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2
Nov 03 17:13:16 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:16 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2" returned: 0 in 0.256s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038056b4-82c8-4152-be4c-2097483ea6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7953bca-145c-41e8-9408-384a22e75bf2', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d689b59-ea74-4894-9454-ae82414eb440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Volume volume-d7953bca-145c-41e8-9408-384a22e75bf2 (d7953bca-145c-41e8-9408-384a22e75bf2): created successfully
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d689b59-ea74-4894-9454-ae82414eb440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Flow 'volume_create_manager' (20c1ac38-cb0d-4d5c-90ad-d77329b42507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-10efe9c4-5305-44d4-a1dc-04ed7ae08a31 tempest-SnapshotDependencyTests-252661794 None] Created volume successfully.
Nov 03 17:13:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] Creating offline snapshot aaf0b736-9cc7-4d07-8d4a-cc55f10e979c of volume d7953bca-145c-41e8-9408-384a22e75bf2 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:13:17 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2dff4e-e0c8-4707-89a3-d6c2d9bbadae]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:13:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:17 devstack sudo[106699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2
Nov 03 17:13:17 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:17 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2" returned: 0 in 0.353s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:17 devstack sudo[106704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c 1G
Nov 03 17:13:17 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:18 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c 1G" returned: 0 in 0.390s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7953bca-145c-41e8-9408-384a22e75bf2 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:18 devstack sudo[106710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7953bca-145c-41e8-9408-384a22e75bf2 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c
Nov 03 17:13:18 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:18 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7953bca-145c-41e8-9408-384a22e75bf2 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:18 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c is being set with open permissions: ugo+rw
Nov 03 17:13:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:18 devstack sudo[106715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c
Nov 03 17:13:18 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:18 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c" returned: 0 in 0.228s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:18 devstack sudo[106718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.info
Nov 03 17:13:18 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:18 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.info" returned: 0 in 0.238s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:18 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.info is being set with open permissions: ugo+rw
Nov 03 17:13:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:18 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.info
Nov 03 17:13:18 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:19 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.info" returned: 0 in 0.234s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f27b7204-20df-4f15-a752-061e7495d234 tempest-SnapshotDependencyTests-252661794 None] Create snapshot completed successfully
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Flow 'volume_create_manager' (5441c6b1-0992-4ff1-8ae8-b912ce15720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9895296f-34b2-443b-b051-726de3c3731f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9895296f-34b2-443b-b051-726de3c3731f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9304cdf0-1d51-4028-b4cc-1652feb59278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf907edc44a2434f8c3f5ea098b8dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aaf0b736-9cc7-4d07-8d4a-cc55f10e979c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:20Z,use_quota=True,user_id='ef61642c931d4569b30fb9f4c46c8186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9311392a-a796-4288-9d55-8b5d931ef564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9311392a-a796-4288-9d55-8b5d931ef564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacf29fa-dd40-4bc5-88d3-b24c2d95529d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacf29fa-dd40-4bc5-88d3-b24c2d95529d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9304cdf0-1d51-4028-b4cc-1652feb59278', 'volume_name': 'volume-9304cdf0-1d51-4028-b4cc-1652feb59278', 'volume_size': 1, 'snapshot_id': 'aaf0b736-9cc7-4d07-8d4a-cc55f10e979c'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05a7951-7059-43eb-8645-8df4d7754c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05a7951-7059-43eb-8645-8df4d7754c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9503e9-849a-40a5-a935-6bc581bf8511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Volume 9304cdf0-1d51-4028-b4cc-1652feb59278: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9304cdf0-1d51-4028-b4cc-1652feb59278', 'volume_size': 1, 'snapshot_id': 'aaf0b736-9cc7-4d07-8d4a-cc55f10e979c'}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "cinder-quobyte-aaf0b736-9cc7-4d07-8d4a-cc55f10e979c-9304cdf0-1d51-4028-b4cc-1652feb59278" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-quobyte-aaf0b736-9cc7-4d07-8d4a-cc55f10e979c-9304cdf0-1d51-4028-b4cc-1652feb59278" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Creating volume 9304cdf0-1d51-4028-b4cc-1652feb59278 from snapshot aaf0b736-9cc7-4d07-8d4a-cc55f10e979c {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "cinder-quobyte-9304cdf0-1d51-4028-b4cc-1652feb59278" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-quobyte-9304cdf0-1d51-4028-b4cc-1652feb59278" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] snapshot: aaf0b736-9cc7-4d07-8d4a-cc55f10e979c, volume: 9304cdf0-1d51-4028-b4cc-1652feb59278,  {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a55018-4141-4ff7-bd33-a3869fd2a7b6]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:20 devstack sudo[106760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c
Nov 03 17:13:20 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:20 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c" returned: 0 in 0.360s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7953bca-145c-41e8-9408-384a22e75bf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfac929-f0e5-40aa-a492-f78dfedd8dd2]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:13:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:20 devstack sudo[106765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2
Nov 03 17:13:20 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:21 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2" returned: 0 in 0.361s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 17:13:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 17:13:21 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Path /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 17:13:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:21 devstack sudo[106771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278
Nov 03 17:13:21 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:26 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278" returned: 0 in 5.387s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:26 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:13:26 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Converted 1024.00 MB image at 190.04 MB/s
Nov 03 17:13:26 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278 is being set with open permissions: ugo+rw
Nov 03 17:13:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:26 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278
Nov 03 17:13:26 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:26 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-quobyte-9304cdf0-1d51-4028-b4cc-1652feb59278" released by "_copy_volume_from_snapshot" :: held 6.439s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:13:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-quobyte-aaf0b736-9cc7-4d07-8d4a-cc55f10e979c-9304cdf0-1d51-4028-b4cc-1652feb59278" released by "_create_volume_from_snapshot" :: held 6.502s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:13:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.517s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9503e9-849a-40a5-a935-6bc581bf8511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9304cdf0-1d51-4028-b4cc-1652feb59278', 'volume_size': 1, 'snapshot_id': 'aaf0b736-9cc7-4d07-8d4a-cc55f10e979c'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180e86d3-5c06-4715-97b6-b7287f17e3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Volume volume-9304cdf0-1d51-4028-b4cc-1652feb59278 (9304cdf0-1d51-4028-b4cc-1652feb59278): created successfully
Nov 03 17:13:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180e86d3-5c06-4715-97b6-b7287f17e3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Flow 'volume_create_manager' (5441c6b1-0992-4ff1-8ae8-b912ce15720b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e33bf265-b2cf-467f-85b9-151b2ea93a87 tempest-SnapshotDependencyTests-252661794 None] Created volume successfully.
Nov 03 17:13:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "cinder-aaf0b736-9cc7-4d07-8d4a-cc55f10e979c-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:13:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-aaf0b736-9cc7-4d07-8d4a-cc55f10e979c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:13:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "cinder-quobyte-d7953bca-145c-41e8-9408-384a22e75bf2" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:13:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-quobyte-d7953bca-145c-41e8-9408-384a22e75bf2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:13:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "cinder-quobyte-aaf0b736-9cc7-4d07-8d4a-cc55f10e979c" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:13:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-quobyte-aaf0b736-9cc7-4d07-8d4a-cc55f10e979c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:13:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Deleting offline snapshot aaf0b736-9cc7-4d07-8d4a-cc55f10e979c of volume d7953bca-145c-41e8-9408-384a22e75bf2 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:13:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] snapshot_file for this snap is: volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:13:27 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[194ea5ef-4c82-492d-8fef-55fd9a5e398e]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:13:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:27 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c
Nov 03 17:13:27 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:28 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c" returned: 0 in 0.374s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7953bca-145c-41e8-9408-384a22e75bf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:13:28 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3019731-e210-4f4c-8c44-92332099a4bc]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:13:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:28 devstack sudo[106792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2
Nov 03 17:13:28 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:28 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2" returned: 0 in 0.541s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:28 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c
Nov 03 17:13:28 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:29 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c" returned: 0 in 0.356s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:29 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c
Nov 03 17:13:29 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:29 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2.aaf0b736-9cc7-4d07-8d4a-cc55f10e979c" returned: 0 in 0.262s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-quobyte-aaf0b736-9cc7-4d07-8d4a-cc55f10e979c" released by "_delete_snapshot" :: held 1.634s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:13:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-quobyte-d7953bca-145c-41e8-9408-384a22e75bf2" released by "delete_snapshot" :: held 1.655s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:13:29 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Created reservations ['cb39a30a-e9c1-44aa-96ec-63dd66171f47', 'd8a05d2d-1d54-4464-bafe-3ab652650907', '839b83ac-cee7-4701-949f-23fca5e6e43d', 'b9c6b572-9938-42f7-8f2f-296c41016c72'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:13:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Delete snapshot completed successfully.
Nov 03 17:13:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1f88cdb2-af51-456b-b638-f0aaa07326e2 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-aaf0b736-9cc7-4d07-8d4a-cc55f10e979c-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:13:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "cinder-d7953bca-145c-41e8-9408-384a22e75bf2-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:13:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-d7953bca-145c-41e8-9408-384a22e75bf2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:13:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "cinder-quobyte-d7953bca-145c-41e8-9408-384a22e75bf2" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:13:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-quobyte-d7953bca-145c-41e8-9408-384a22e75bf2" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:13:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1819c69-66c7-437e-b975-b546ec9ee620]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:13:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:30 devstack sudo[106806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2
Nov 03 17:13:30 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:30 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2" returned: 0 in 0.406s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:30 devstack sudo[106811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2
Nov 03 17:13:30 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:30 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d7953bca-145c-41e8-9408-384a22e75bf2" returned: 0 in 0.259s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-quobyte-d7953bca-145c-41e8-9408-384a22e75bf2" released by "delete_volume" :: held 0.735s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:13:30 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Created reservations ['a326c868-d40e-4c31-bff3-e43e37ed9090', '4dda91bb-670f-47f4-aa9a-977e58924105', '8cc5bee7-c37d-4de3-b07f-e73aeb902380', 'b50e2cc0-5b24-4e05-b591-18818d0edb94'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:13:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:13:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:13:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:30 devstack sudo[106815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:13:30 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:31 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.243s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "cinder-9304cdf0-1d51-4028-b4cc-1652feb59278-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:13:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Deleted volume successfully.
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-9304cdf0-1d51-4028-b4cc-1652feb59278-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-33214716-9438-4199-ab4b-704de6341e17 tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-d7953bca-145c-41e8-9408-384a22e75bf2-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "cinder-quobyte-9304cdf0-1d51-4028-b4cc-1652feb59278" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-quobyte-9304cdf0-1d51-4028-b4cc-1652feb59278" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ca9ebe-96d9-49b0-a2f9-e962dedb3b50]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:31 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278
Nov 03 17:13:31 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:31 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278" returned: 0 in 0.413s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:31 devstack sudo[106823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278
Nov 03 17:13:31 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:31 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9304cdf0-1d51-4028-b4cc-1652feb59278" returned: 0 in 0.271s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-quobyte-9304cdf0-1d51-4028-b4cc-1652feb59278" released by "delete_volume" :: held 0.725s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:13:31 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Created reservations ['32b1a9d6-01bb-4d3f-b175-8178cfd97172', '5dc9f452-df40-4812-b083-d8c5a930084f', '245204ea-c090-4b60-ae3d-e8ffacdb16af', 'd4412f55-6ee7-4033-8e16-44a3088d2a55'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:13:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:13:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:13:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:32 devstack sudo[106826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:13:32 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:32 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.316s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:32 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:13:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Deleted volume successfully.
Nov 03 17:13:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-07ad7811-b26a-4a2b-af29-017884bb759c tempest-SnapshotDependencyTests-252661794 None] Lock "cinder-9304cdf0-1d51-4028-b4cc-1652feb59278-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:13:42 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=26,cinder:SELECT=26,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:13:42 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=23,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=4 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:13:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:13:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:13:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:13:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:51 devstack sudo[106877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:13:51 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:52 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.362s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:13:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:13:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 29 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:13:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>, <Thread(Rabbit-heartbeat, started daemon 139029247180864)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Flow 'volume_create_manager' (ce1c74e1-b7ef-4244-9726-a521f2ed6fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc6190b-3a77-46b5-b4d8-b9a9d0220f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Flow 'volume_create_manager' (2f707727-3774-425c-a4b5-74cd0698fd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18349532-85b6-4c3a-98d0-7d52f35d340c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc6190b-3a77-46b5-b4d8-b9a9d0220f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1678835394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd25f37e-b61f-4daa-86e9-8b21cb2e2980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb6205c3294cdf92a9ddd94a6c055a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:56Z,use_quota=True,user_id='9d60abf5a30944f4a20c641813ade7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ef9771-0f18-4c0d-848c-0854eda2c02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ef9771-0f18-4c0d-848c-0854eda2c02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd73fef9-acaf-4df7-b932-6e82ba4e1487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd73fef9-acaf-4df7-b932-6e82ba4e1487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd25f37e-b61f-4daa-86e9-8b21cb2e2980', 'volume_name': 'volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28542e07-1ade-406f-be77-75478c6d1e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28542e07-1ade-406f-be77-75478c6d1e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63cf363-ed9c-4a6c-bbad-5127d43d1a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:55 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Volume bd25f37e-b61f-4daa-86e9-8b21cb2e2980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980', 'volume_size': 1}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1678835394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd25f37e-b61f-4daa-86e9-8b21cb2e2980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb6205c3294cdf92a9ddd94a6c055a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:56Z,use_quota=True,user_id='9d60abf5a30944f4a20c641813ade7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Creating volume bd25f37e-b61f-4daa-86e9-8b21cb2e2980 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:13:55 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:55 devstack sudo[106882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980 1073741824
Nov 03 17:13:55 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18349532-85b6-4c3a-98d0-7d52f35d340c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2082413537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0845569-3c4e-400e-aeab-9bf06ed4506a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4db197c06c4b1bacf3e26911bf9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:56Z,use_quota=True,user_id='c9a0eb106f9b48a0bfe6a3c4db4fc0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627e8f56-5a89-4ab1-81a1-79ce3d98ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627e8f56-5a89-4ab1-81a1-79ce3d98ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00768f4-aba8-413d-accd-1317d0674007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00768f4-aba8-413d-accd-1317d0674007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0845569-3c4e-400e-aeab-9bf06ed4506a', 'volume_name': 'volume-a0845569-3c4e-400e-aeab-9bf06ed4506a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44af5617-677d-4239-add2-66b59fea8e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44af5617-677d-4239-add2-66b59fea8e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba134be-fc21-4cf9-a5cf-fa7bb5d5807f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:55 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume a0845569-3c4e-400e-aeab-9bf06ed4506a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0845569-3c4e-400e-aeab-9bf06ed4506a', 'volume_size': 1}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:13:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Flow 'volume_create_manager' (bc7a33a7-c1c2-4377-8b7d-1cdd2ab25fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00194c5-ebe8-4975-b6de-90343898f806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00194c5-ebe8-4975-b6de-90343898f806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1492455470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153c7a7f-fe62-452b-a2e4-49c177679f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb6205c3294cdf92a9ddd94a6c055a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:56Z,use_quota=True,user_id='9d60abf5a30944f4a20c641813ade7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8717b4df-13d2-43c8-8043-33b6840cb1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8717b4df-13d2-43c8-8043-33b6840cb1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafede3e-bdd3-49d0-ba7d-a2f31f2288a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafede3e-bdd3-49d0-ba7d-a2f31f2288a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153c7a7f-fe62-452b-a2e4-49c177679f7b', 'volume_name': 'volume-153c7a7f-fe62-452b-a2e4-49c177679f7b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b33d1c-7727-4092-b7f0-d6a04e0f5d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b33d1c-7727-4092-b7f0-d6a04e0f5d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0650c0-b55a-47ca-bdff-6510477b3dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:56 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Volume 153c7a7f-fe62-452b-a2e4-49c177679f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153c7a7f-fe62-452b-a2e4-49c177679f7b', 'volume_size': 1}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Flow 'volume_create_manager' (24a4f891-a0e5-47a7-a2b9-411f01e93aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5a202c-50a9-420b-b10d-e649cf34fcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5a202c-50a9-420b-b10d-e649cf34fcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1487489334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f39f2338-12a4-449e-983a-c8393c6ed8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb6205c3294cdf92a9ddd94a6c055a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:56Z,use_quota=True,user_id='9d60abf5a30944f4a20c641813ade7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:56 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bde6fd1-8812-4537-bd23-bf7b886021ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bde6fd1-8812-4537-bd23-bf7b886021ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c9d73e-926f-4caa-999f-14c26235db41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c9d73e-926f-4caa-999f-14c26235db41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f39f2338-12a4-449e-983a-c8393c6ed8fe', 'volume_name': 'volume-f39f2338-12a4-449e-983a-c8393c6ed8fe', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a748d58-c6c9-4061-8a4a-7c591f6ba693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a748d58-c6c9-4061-8a4a-7c591f6ba693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0764c4b-eed0-449f-b14c-cfd9b8ce1036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:56 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Volume f39f2338-12a4-449e-983a-c8393c6ed8fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f39f2338-12a4-449e-983a-c8393c6ed8fe', 'volume_size': 1}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980 1073741824" returned: 0 in 0.921s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:56 devstack sudo[106888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980
Nov 03 17:13:56 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:57 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980" returned: 0 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.251s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2082413537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0845569-3c4e-400e-aeab-9bf06ed4506a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4db197c06c4b1bacf3e26911bf9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:56Z,use_quota=True,user_id='c9a0eb106f9b48a0bfe6a3c4db4fc0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Creating volume a0845569-3c4e-400e-aeab-9bf06ed4506a {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:13:57 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a0845569-3c4e-400e-aeab-9bf06ed4506a 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63cf363-ed9c-4a6c-bbad-5127d43d1a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:57 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a0845569-3c4e-400e-aeab-9bf06ed4506a 1073741824
Nov 03 17:13:57 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d336daa9-b3f3-4821-95ef-6059f9af05d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:57 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Volume volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980 (bd25f37e-b61f-4daa-86e9-8b21cb2e2980): created successfully
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d336daa9-b3f3-4821-95ef-6059f9af05d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Flow 'volume_create_manager' (ce1c74e1-b7ef-4244-9726-a521f2ed6fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Flow 'volume_create_manager' (12ac5eea-d605-4023-a99e-5f7f91e67ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a45dcd2-d813-47b9-9f30-836a759d6ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0539c6bc-ccfb-4275-9611-b09c94b1959b tempest-CreateVolumesFromImageTest-857003541 None] Created volume successfully.
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a45dcd2-d813-47b9-9f30-836a759d6ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1184111984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f9d9fb-932a-4329-af75-469b8be4e5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb6205c3294cdf92a9ddd94a6c055a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:57Z,use_quota=True,user_id='9d60abf5a30944f4a20c641813ade7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a404aace-d1fe-49fc-9745-6b43ba0b0594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a404aace-d1fe-49fc-9745-6b43ba0b0594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3591d5f-c2bb-49f7-9363-daaf6dcdaed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3591d5f-c2bb-49f7-9363-daaf6dcdaed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f9d9fb-932a-4329-af75-469b8be4e5be', 'volume_name': 'volume-e9f9d9fb-932a-4329-af75-469b8be4e5be', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bb3f39-82b7-4e6f-a191-8dff264cc3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bb3f39-82b7-4e6f-a191-8dff264cc3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509cf8d0-6b16-4318-8711-d035bedb6a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:57 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Volume e9f9d9fb-932a-4329-af75-469b8be4e5be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f9d9fb-932a-4329-af75-469b8be4e5be', 'volume_size': 1}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Flow 'volume_create_manager' (d98ca0ce-bb86-4df8-bb2b-d0aece67e686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:57 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62175aa1-1fa7-4659-ad33-366686f4752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a0845569-3c4e-400e-aeab-9bf06ed4506a 1073741824" returned: 0 in 0.798s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62175aa1-1fa7-4659-ad33-366686f4752c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2106676664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3efb1563-b1ae-460e-a148-689e4e45726a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb6205c3294cdf92a9ddd94a6c055a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:58Z,use_quota=True,user_id='9d60abf5a30944f4a20c641813ade7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86246533-7a3c-435e-9492-974070fabbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86246533-7a3c-435e-9492-974070fabbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8d53eb-0867-4e65-a0d7-01b2856d76fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8d53eb-0867-4e65-a0d7-01b2856d76fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3efb1563-b1ae-460e-a148-689e4e45726a', 'volume_name': 'volume-3efb1563-b1ae-460e-a148-689e4e45726a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf1fd0c-f0ff-4542-a1b6-8dd8b8f3c8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf1fd0c-f0ff-4542-a1b6-8dd8b8f3c8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0cc034-1184-4edc-b33d-fedd6d556a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Volume 3efb1563-b1ae-460e-a148-689e4e45726a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3efb1563-b1ae-460e-a148-689e4e45726a', 'volume_size': 1}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a0845569-3c4e-400e-aeab-9bf06ed4506a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:58 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a0845569-3c4e-400e-aeab-9bf06ed4506a
Nov 03 17:13:58 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:58 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a0845569-3c4e-400e-aeab-9bf06ed4506a" returned: 0 in 0.381s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.451s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1492455470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153c7a7f-fe62-452b-a2e4-49c177679f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb6205c3294cdf92a9ddd94a6c055a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:56Z,use_quota=True,user_id='9d60abf5a30944f4a20c641813ade7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Creating volume 153c7a7f-fe62-452b-a2e4-49c177679f7b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:13:58 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-153c7a7f-fe62-452b-a2e4-49c177679f7b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:58 devstack sudo[106899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-153c7a7f-fe62-452b-a2e4-49c177679f7b 1073741824
Nov 03 17:13:58 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba134be-fc21-4cf9-a5cf-fa7bb5d5807f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0845569-3c4e-400e-aeab-9bf06ed4506a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251e85a0-6805-4dab-a107-309f7def4946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume volume-a0845569-3c4e-400e-aeab-9bf06ed4506a (a0845569-3c4e-400e-aeab-9bf06ed4506a): created successfully
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251e85a0-6805-4dab-a107-309f7def4946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Flow 'volume_create_manager' (2f707727-3774-425c-a4b5-74cd0698fd06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ef0f1173-d680-4c3a-a161-db632be91357 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Created volume successfully.
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:13:59 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Flow 'volume_create_manager' (2c053853-99af-40cd-824f-3a92a814f200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa82f4a-48cc-4b02-a9aa-0fbe53a5c83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-153c7a7f-fe62-452b-a2e4-49c177679f7b 1073741824" returned: 0 in 0.594s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa82f4a-48cc-4b02-a9aa-0fbe53a5c83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd62cd34-f748-4d83-8db4-4a51bc49a7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d0a88fd17c54764bd35e6db9bcb5833',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:59Z,use_quota=True,user_id='beb8a3f00822418186ce609aee9983d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f704e40d-c385-4066-a1e1-3caa806214b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f704e40d-c385-4066-a1e1-3caa806214b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d1047c-2fb1-4bc0-91c5-a61285c3f20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-153c7a7f-fe62-452b-a2e4-49c177679f7b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:59 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-153c7a7f-fe62-452b-a2e4-49c177679f7b
Nov 03 17:13:59 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d1047c-2fb1-4bc0-91c5-a61285c3f20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd62cd34-f748-4d83-8db4-4a51bc49a7a5', 'volume_name': 'volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5', 'volume_size': 1, 'image_id': 'b5c6598b-f350-4a2b-a990-bb60e98720f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5c6598b-f350-4a2b-a990-bb60e98720f4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '345a72fa91b6a4a831b34207185cd8df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d0a88fd17c54764bd35e6db9bcb5833', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c93e3b05109454df935a0651a02cb326d1eca2e76b4b47fb8c261f1e7177ff63902c4b8d53cda5b647ae9a7f90f842331088ee99dde62719b54cab598d611dc', 'id': 'b5c6598b-f350-4a2b-a990-bb60e98720f4', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5c6598b-f350-4a2b-a990-bb60e98720f4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e723a85fc50>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d68298-963a-4007-ad35-3fcf897daf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d68298-963a-4007-ad35-3fcf897daf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd0dac7-d0e2-4e0e-8ad9-52570e2c48dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:59 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Volume dd62cd34-f748-4d83-8db4-4a51bc49a7a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5', 'volume_size': 1, 'image_id': 'b5c6598b-f350-4a2b-a990-bb60e98720f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5c6598b-f350-4a2b-a990-bb60e98720f4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '345a72fa91b6a4a831b34207185cd8df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d0a88fd17c54764bd35e6db9bcb5833', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c93e3b05109454df935a0651a02cb326d1eca2e76b4b47fb8c261f1e7177ff63902c4b8d53cda5b647ae9a7f90f842331088ee99dde62719b54cab598d611dc', 'id': 'b5c6598b-f350-4a2b-a990-bb60e98720f4', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5c6598b-f350-4a2b-a990-bb60e98720f4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e723a85fc50>}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Trying to clone dd62cd34-f748-4d83-8db4-4a51bc49a7a5 from image b5c6598b-f350-4a2b-a990-bb60e98720f4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5c6598b-f350-4a2b-a990-bb60e98720f4', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 17:13:59 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-153c7a7f-fe62-452b-a2e4-49c177679f7b" returned: 0 in 0.289s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.793s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1487489334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f39f2338-12a4-449e-983a-c8393c6ed8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb6205c3294cdf92a9ddd94a6c055a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:56Z,use_quota=True,user_id='9d60abf5a30944f4a20c641813ade7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Creating volume f39f2338-12a4-449e-983a-c8393c6ed8fe {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:13:59 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f39f2338-12a4-449e-983a-c8393c6ed8fe 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:59 devstack sudo[106908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f39f2338-12a4-449e-983a-c8393c6ed8fe 1073741824
Nov 03 17:13:59 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0650c0-b55a-47ca-bdff-6510477b3dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153c7a7f-fe62-452b-a2e4-49c177679f7b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77da908b-0c89-4a65-a97f-c02e3719aef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 17:13:59 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 17:13:59 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Volume volume-153c7a7f-fe62-452b-a2e4-49c177679f7b (153c7a7f-fe62-452b-a2e4-49c177679f7b): created successfully
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77da908b-0c89-4a65-a97f-c02e3719aef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Flow 'volume_create_manager' (bc7a33a7-c1c2-4377-8b7d-1cdd2ab25fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:13:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b1d6d6ff-0305-4b71-87cb-74686a957929 tempest-CreateVolumesFromImageTest-857003541 None] Created volume successfully.
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5b15bd-f77b-4827-ac22-f9f6f2225534]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:13:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:13:59 devstack sudo[106910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD
Nov 03 17:13:59 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:00 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:00 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f39f2338-12a4-449e-983a-c8393c6ed8fe 1073741824" returned: 0 in 0.607s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f39f2338-12a4-449e-983a-c8393c6ed8fe {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:00 devstack sudo[106918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD
Nov 03 17:14:00 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:00 devstack sudo[106919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f39f2338-12a4-449e-983a-c8393c6ed8fe
Nov 03 17:14:00 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:00 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD" returned: 1 in 0.487s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Temporary image b5c6598b-f350-4a2b-a990-bb60e98720f4 is fetched for user beb8a3f00822418186ce609aee9983d7. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 17:14:00 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f39f2338-12a4-449e-983a-c8393c6ed8fe" returned: 0 in 0.417s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.121s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1184111984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f9d9fb-932a-4329-af75-469b8be4e5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb6205c3294cdf92a9ddd94a6c055a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:57Z,use_quota=True,user_id='9d60abf5a30944f4a20c641813ade7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Creating volume e9f9d9fb-932a-4329-af75-469b8be4e5be {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:00 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e9f9d9fb-932a-4329-af75-469b8be4e5be 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:00 devstack sudo[106926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e9f9d9fb-932a-4329-af75-469b8be4e5be 1073741824
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0764c4b-eed0-449f-b14c-cfd9b8ce1036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f39f2338-12a4-449e-983a-c8393c6ed8fe', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:00 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d985f31d-f0cc-4d18-9bbf-3af5ce067e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Flow 'volume_create_manager' (b5858e51-6728-4ca9-8a46-782c7c8a1089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de5a890-6f51-47e0-98ac-3ef004e485d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:00 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Volume volume-f39f2338-12a4-449e-983a-c8393c6ed8fe (f39f2338-12a4-449e-983a-c8393c6ed8fe): created successfully
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d985f31d-f0cc-4d18-9bbf-3af5ce067e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Flow 'volume_create_manager' (24a4f891-a0e5-47a7-a2b9-411f01e93aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de5a890-6f51-47e0-98ac-3ef004e485d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281311880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f13ea92-2b54-4561-b5e7-6bd2dcf3faad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4db197c06c4b1bacf3e26911bf9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:01Z,use_quota=True,user_id='c9a0eb106f9b48a0bfe6a3c4db4fc0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20605a3a-ebfc-44ef-a2fb-3122dc22e171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20605a3a-ebfc-44ef-a2fb-3122dc22e171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411551da-ebfa-44ef-9499-02a8abd87cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411551da-ebfa-44ef-9499-02a8abd87cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f13ea92-2b54-4561-b5e7-6bd2dcf3faad', 'volume_name': 'volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8fd410-3e1a-4f13-97eb-5546eebdc9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8fd410-3e1a-4f13-97eb-5546eebdc9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61953284-239e-4868-a0c4-49335b471914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:00 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume 4f13ea92-2b54-4561-b5e7-6bd2dcf3faad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad', 'volume_size': 1}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:00 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ac08b1d6-9e86-4cf7-8866-baedc8723bac tempest-CreateVolumesFromImageTest-857003541 None] Created volume successfully.
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a28d4d-1e22-46b3-9adf-7a1e0b442169]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:01 devstack sudo[106929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD
Nov 03 17:14:01 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Flow 'volume_create_manager' (154ed8a5-3d2d-413c-a5d3-cdc6af29d98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3eb095-e65f-41b4-b7f9-4769b5172c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3eb095-e65f-41b4-b7f9-4769b5172c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af827ed1-beb4-42c4-b41b-6ddfe32251c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f8abe3a8674ae590c5501e6e7c7332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:01Z,use_quota=True,user_id='28078ef9c06e413db555e429d7381bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15cc12aa-8950-433f-8304-7da5592abcd2),volume_type_id=15cc12aa-8950-433f-8304-7da5592abcd2)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627c016b-1e8e-4686-a386-2c7c735557f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627c016b-1e8e-4686-a386-2c7c735557f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c309ec-6c16-4333-9097-8e836502a29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e9f9d9fb-932a-4329-af75-469b8be4e5be 1073741824" returned: 0 in 0.611s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Flow 'volume_create_manager' (f8b641d7-236a-4dda-91a4-2bad93ca5f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877ee730-00a7-4101-b38a-dbff5955e2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877ee730-00a7-4101-b38a-dbff5955e2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-505918109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a70ee48-c3af-4c99-a0c0-f9858e14525d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4db197c06c4b1bacf3e26911bf9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:01Z,use_quota=True,user_id='c9a0eb106f9b48a0bfe6a3c4db4fc0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e74190-c2a4-4be0-a996-0172ed307fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e74190-c2a4-4be0-a996-0172ed307fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d94c54-4055-46ff-ac6b-237fb7b5de32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d94c54-4055-46ff-ac6b-237fb7b5de32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a70ee48-c3af-4c99-a0c0-f9858e14525d', 'volume_name': 'volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d201a343-49db-4275-967f-12f543154dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d201a343-49db-4275-967f-12f543154dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9151c4c8-5d82-4f8c-864a-130bae7e5b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume 2a70ee48-c3af-4c99-a0c0-f9858e14525d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d', 'volume_size': 1}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e9f9d9fb-932a-4329-af75-469b8be4e5be {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:01 devstack sudo[106938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e9f9d9fb-932a-4329-af75-469b8be4e5be
Nov 03 17:14:01 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:01 devstack sudo[106937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD
Nov 03 17:14:01 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Flow 'volume_create_manager' (2832bbb3-dd91-49eb-8a36-a50c29373e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bdff8fb-f61e-49f7-8f21-3875ef1dfdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bdff8fb-f61e-49f7-8f21-3875ef1dfdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-689231502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4db197c06c4b1bacf3e26911bf9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:02Z,use_quota=True,user_id='c9a0eb106f9b48a0bfe6a3c4db4fc0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4bb51f-8eab-401e-8990-325f51caa911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4bb51f-8eab-401e-8990-325f51caa911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adcc5c0b-09a3-4411-9228-a65dfea8de05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adcc5c0b-09a3-4411-9228-a65dfea8de05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa', 'volume_name': 'volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84cfd93-dda6-4185-af69-6c1d1385bdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84cfd93-dda6-4185-af69-6c1d1385bdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a248f7-74ec-4ab7-b082-41d801c7e12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa', 'volume_size': 1}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:01 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c309ec-6c16-4333-9097-8e836502a29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'af827ed1-beb4-42c4-b41b-6ddfe32251c4', 'volume_name': 'volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4', 'volume_size': 1, 'image_id': 'a3e03e98-def9-46b0-9212-01c22f6c358f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3e03e98-def9-46b0-9212-01c22f6c358f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd521310d18dbb9967add60870b8cfa30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06f8abe3a8674ae590c5501e6e7c7332', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7178b34c7ecbd5a8eea2ca7778e7801429c423e6502f0b398b5cb6dfad100c814eb82bcd93bfff9065e206f985fbd6a59dd8de213745de8fbf61c6aeb3a2e77a', 'id': 'a3e03e98-def9-46b0-9212-01c22f6c358f', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3e03e98-def9-46b0-9212-01c22f6c358f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e7245142660>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1c9109-64b9-47b4-935c-ac1734e24822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1c9109-64b9-47b4-935c-ac1734e24822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15b9dfd-ed6a-4608-8861-d8af5f3507a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:01 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Volume af827ed1-beb4-42c4-b41b-6ddfe32251c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4', 'volume_size': 1, 'image_id': 'a3e03e98-def9-46b0-9212-01c22f6c358f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3e03e98-def9-46b0-9212-01c22f6c358f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd521310d18dbb9967add60870b8cfa30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06f8abe3a8674ae590c5501e6e7c7332', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7178b34c7ecbd5a8eea2ca7778e7801429c423e6502f0b398b5cb6dfad100c814eb82bcd93bfff9065e206f985fbd6a59dd8de213745de8fbf61c6aeb3a2e77a', 'id': 'a3e03e98-def9-46b0-9212-01c22f6c358f', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3e03e98-def9-46b0-9212-01c22f6c358f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e7245142660>}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Trying to clone af827ed1-beb4-42c4-b41b-6ddfe32251c4 from image a3e03e98-def9-46b0-9212-01c22f6c358f at location (None, [{'url': 'file:///opt/stack/data/glance/images/a3e03e98-def9-46b0-9212-01c22f6c358f', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD" returned: 1 in 0.490s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:01 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e9f9d9fb-932a-4329-af75-469b8be4e5be" returned: 0 in 0.474s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.780s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2106676664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3efb1563-b1ae-460e-a148-689e4e45726a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb6205c3294cdf92a9ddd94a6c055a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:58Z,use_quota=True,user_id='9d60abf5a30944f4a20c641813ade7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Creating volume 3efb1563-b1ae-460e-a148-689e4e45726a {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:01 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3efb1563-b1ae-460e-a148-689e4e45726a 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:01 devstack sudo[106945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3efb1563-b1ae-460e-a148-689e4e45726a 1073741824
Nov 03 17:14:01 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509cf8d0-6b16-4318-8711-d035bedb6a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f9d9fb-932a-4329-af75-469b8be4e5be', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c605f17-3986-4ab6-8239-94babff214dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:02 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Volume volume-e9f9d9fb-932a-4329-af75-469b8be4e5be (e9f9d9fb-932a-4329-af75-469b8be4e5be): created successfully
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c605f17-3986-4ab6-8239-94babff214dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Flow 'volume_create_manager' (12ac5eea-d605-4023-a99e-5f7f91e67ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-374d8328-c115-415b-ae0d-4d0768b14234 tempest-CreateVolumesFromImageTest-857003541 None] Created volume successfully.
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 17:14:02 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c94063d-7273-4288-beb7-3302f1885639]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:02 devstack sudo[106947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD
Nov 03 17:14:02 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Flow 'volume_create_manager' (406b082b-c570-4af1-92ea-ec12b3fa1833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf46749-f843-4eef-91cb-08379ca9f456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf46749-f843-4eef-91cb-08379ca9f456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-235830641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4270a962-edfc-4a62-bfe6-dc3b5c48d1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4db197c06c4b1bacf3e26911bf9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:02Z,use_quota=True,user_id='c9a0eb106f9b48a0bfe6a3c4db4fc0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc9bdf1-6f94-4c53-aa03-ee63ad74815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc9bdf1-6f94-4c53-aa03-ee63ad74815a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a8478e-44de-4298-ac85-bc269af024f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a8478e-44de-4298-ac85-bc269af024f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4270a962-edfc-4a62-bfe6-dc3b5c48d1c7', 'volume_name': 'volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed87de2c-8ccc-4440-8797-644690240ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed87de2c-8ccc-4440-8797-644690240ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbea838-4223-4099-a5be-01dee000021c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:02 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume 4270a962-edfc-4a62-bfe6-dc3b5c48d1c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7', 'volume_size': 1}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:02 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3efb1563-b1ae-460e-a148-689e4e45726a 1073741824" returned: 0 in 0.666s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3efb1563-b1ae-460e-a148-689e4e45726a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:02 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:02 devstack sudo[106955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3efb1563-b1ae-460e-a148-689e4e45726a
Nov 03 17:14:02 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Flow 'volume_create_manager' (80eba4ae-33f6-485e-848b-8dfc55724aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9289ee33-5332-4b27-b69c-8f1bcb2e59ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9289ee33-5332-4b27-b69c-8f1bcb2e59ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1318793401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dae2900-89a6-406d-b23a-511bef20702e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4db197c06c4b1bacf3e26911bf9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:03Z,use_quota=True,user_id='c9a0eb106f9b48a0bfe6a3c4db4fc0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b421aa29-18b1-45c0-a79f-39fac12efba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b421aa29-18b1-45c0-a79f-39fac12efba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3660154-d2fa-4ee7-9e27-6a89006709aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3660154-d2fa-4ee7-9e27-6a89006709aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dae2900-89a6-406d-b23a-511bef20702e', 'volume_name': 'volume-3dae2900-89a6-406d-b23a-511bef20702e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2816e5d6-c5ee-4bcf-9a68-ee504aabcbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2816e5d6-c5ee-4bcf-9a68-ee504aabcbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3086dc33-07e4-4c02-b3b6-0c474794a733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:02 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume 3dae2900-89a6-406d-b23a-511bef20702e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dae2900-89a6-406d-b23a-511bef20702e', 'volume_size': 1}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:02 devstack sudo[106957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD
Nov 03 17:14:02 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:02 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3efb1563-b1ae-460e-a148-689e4e45726a" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.040s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281311880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f13ea92-2b54-4561-b5e7-6bd2dcf3faad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4db197c06c4b1bacf3e26911bf9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:01Z,use_quota=True,user_id='c9a0eb106f9b48a0bfe6a3c4db4fc0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Creating volume 4f13ea92-2b54-4561-b5e7-6bd2dcf3faad {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:02 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0cc034-1184-4edc-b33d-fedd6d556a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3efb1563-b1ae-460e-a148-689e4e45726a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:02 devstack sudo[106960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad 1073741824
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657f8073-e013-4cc1-b9a0-34ee09ad6b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:02 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:02 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Volume volume-3efb1563-b1ae-460e-a148-689e4e45726a (3efb1563-b1ae-460e-a148-689e4e45726a): created successfully
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657f8073-e013-4cc1-b9a0-34ee09ad6b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Flow 'volume_create_manager' (d98ca0ce-bb86-4df8-bb2b-d0aece67e686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fb9f4711-2d07-4d03-8333-78f126e5200c tempest-CreateVolumesFromImageTest-857003541 None] Created volume successfully.
Nov 03 17:14:03 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Temporary image a3e03e98-def9-46b0-9212-01c22f6c358f is fetched for user 28078ef9c06e413db555e429d7381bc7. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c258927f-a827-48ca-a622-d653096d5a9e]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "cinder-3efb1563-b1ae-460e-a148-689e4e45726a-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-3efb1563-b1ae-460e-a148-689e4e45726a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "cinder-quobyte-3efb1563-b1ae-460e-a148-689e4e45726a" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-quobyte-3efb1563-b1ae-460e-a148-689e4e45726a" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c6f4a8-72e0-4bc2-b147-e43937193f53]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:03 devstack sudo[106965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3efb1563-b1ae-460e-a148-689e4e45726a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:03 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:03 devstack sudo[106970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3efb1563-b1ae-460e-a148-689e4e45726a
Nov 03 17:14:03 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:03 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad 1073741824" returned: 0 in 0.561s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:03 devstack sudo[106974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad
Nov 03 17:14:03 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:03 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:03 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3efb1563-b1ae-460e-a148-689e4e45726a" returned: 0 in 0.422s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3efb1563-b1ae-460e-a148-689e4e45726a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:03 devstack sudo[106976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD
Nov 03 17:14:03 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:03 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3efb1563-b1ae-460e-a148-689e4e45726a
Nov 03 17:14:03 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:03 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad" returned: 0 in 0.303s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.427s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-505918109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a70ee48-c3af-4c99-a0c0-f9858e14525d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4db197c06c4b1bacf3e26911bf9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:01Z,use_quota=True,user_id='c9a0eb106f9b48a0bfe6a3c4db4fc0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Creating volume 2a70ee48-c3af-4c99-a0c0-f9858e14525d {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:03 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61953284-239e-4868-a0c4-49335b471914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:03 devstack sudo[106984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d 1073741824
Nov 03 17:14:03 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a4cbe4-358f-4e10-9fad-b1c4cda22237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:03 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad (4f13ea92-2b54-4561-b5e7-6bd2dcf3faad): created successfully
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a4cbe4-358f-4e10-9fad-b1c4cda22237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Flow 'volume_create_manager' (b5858e51-6728-4ca9-8a46-782c7c8a1089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f3e58a26-1bce-4657-b5a2-a0cb202964e7 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Created volume successfully.
Nov 03 17:14:03 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:03 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3efb1563-b1ae-460e-a148-689e4e45726a" returned: 0 in 0.298s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-quobyte-3efb1563-b1ae-460e-a148-689e4e45726a" released by "delete_volume" :: held 0.764s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Created reservations ['1e8de524-5d5d-401c-a074-90e3bcac8285', '3492a310-7432-4956-a3ac-b464944af93e', '9ad5130d-3a92-41ff-83c7-6f7b6920c7a1', '202004ce-0f02-4a99-8c5e-ba2feb642523'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:04 devstack sudo[106993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:04 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "cinder-e9f9d9fb-932a-4329-af75-469b8be4e5be-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:04 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d 1073741824" returned: 0 in 0.532s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-e9f9d9fb-932a-4329-af75-469b8be4e5be-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "cinder-quobyte-e9f9d9fb-932a-4329-af75-469b8be4e5be" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:04 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-quobyte-e9f9d9fb-932a-4329-af75-469b8be4e5be" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:04 devstack sudo[106997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d
Nov 03 17:14:04 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.328s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Deleted volume successfully.
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[02217d62-da9e-441f-b4cd-79b72d2e7e33]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e9f9d9fb-932a-4329-af75-469b8be4e5be {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-58debfec-5f18-4776-b533-7670d515648a tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-3efb1563-b1ae-460e-a148-689e4e45726a-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:04 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e9f9d9fb-932a-4329-af75-469b8be4e5be
Nov 03 17:14:04 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:04 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d" returned: 0 in 0.290s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.921s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-689231502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4db197c06c4b1bacf3e26911bf9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:02Z,use_quota=True,user_id='c9a0eb106f9b48a0bfe6a3c4db4fc0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Creating volume c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:04 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:04 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa 1073741824
Nov 03 17:14:04 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9151c4c8-5d82-4f8c-864a-130bae7e5b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7096dc79-ed7a-44b5-9b26-f62a0dead3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:04 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d (2a70ee48-c3af-4c99-a0c0-f9858e14525d): created successfully
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7096dc79-ed7a-44b5-9b26-f62a0dead3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Flow 'volume_create_manager' (f8b641d7-236a-4dda-91a4-2bad93ca5f23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-771b590b-d265-4b97-a367-96c4c10ec6c0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Created volume successfully.
Nov 03 17:14:04 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e9f9d9fb-932a-4329-af75-469b8be4e5be" returned: 0 in 0.434s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e9f9d9fb-932a-4329-af75-469b8be4e5be {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:04 devstack sudo[107007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e9f9d9fb-932a-4329-af75-469b8be4e5be
Nov 03 17:14:04 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:05 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa 1073741824" returned: 0 in 0.482s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:05 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e9f9d9fb-932a-4329-af75-469b8be4e5be" returned: 0 in 0.328s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-quobyte-e9f9d9fb-932a-4329-af75-469b8be4e5be" released by "delete_volume" :: held 0.817s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:05 devstack sudo[107013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa
Nov 03 17:14:05 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Created reservations ['9c295bac-a34e-4772-9f18-750decc2c0be', '48851807-3305-4531-ba25-94b4f285e928', 'fd9b8eb7-bebc-47f2-adbc-d47fb7779ca8', '1b0b0868-49ba-47ff-8301-622c758029ff'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:05 devstack sudo[107015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:05 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:05 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.625s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd62cd34-f748-4d83-8db4-4a51bc49a7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d0a88fd17c54764bd35e6db9bcb5833',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:59Z,use_quota=True,user_id='beb8a3f00822418186ce609aee9983d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Creating volume dd62cd34-f748-4d83-8db4-4a51bc49a7a5 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:05 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "cinder-f39f2338-12a4-449e-983a-c8393c6ed8fe-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:05 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5 1073741824
Nov 03 17:14:05 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a248f7-74ec-4ab7-b082-41d801c7e12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbcc5d8-0901-41d9-8620-3fe21fef0b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-f39f2338-12a4-449e-983a-c8393c6ed8fe-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:05 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa (c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa): created successfully
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbcc5d8-0901-41d9-8620-3fe21fef0b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Flow 'volume_create_manager' (2832bbb3-dd91-49eb-8a36-a50c29373e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-055a262a-7376-4da7-9c6a-37ebe9beb308 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Created volume successfully.
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "cinder-quobyte-f39f2338-12a4-449e-983a-c8393c6ed8fe" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-quobyte-f39f2338-12a4-449e-983a-c8393c6ed8fe" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[095c69c2-658f-44bc-bb70-efa5ba9ca59a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f39f2338-12a4-449e-983a-c8393c6ed8fe {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:05 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.347s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Deleted volume successfully.
Nov 03 17:14:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5461a5d8-4434-4fc3-b29b-79ffa69d4261 tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-e9f9d9fb-932a-4329-af75-469b8be4e5be-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:05 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f39f2338-12a4-449e-983a-c8393c6ed8fe
Nov 03 17:14:05 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:06 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5 1073741824" returned: 0 in 0.581s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:06 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f39f2338-12a4-449e-983a-c8393c6ed8fe" returned: 0 in 0.451s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f39f2338-12a4-449e-983a-c8393c6ed8fe {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:06 devstack sudo[107029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5
Nov 03 17:14:06 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:06 devstack sudo[107030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f39f2338-12a4-449e-983a-c8393c6ed8fe
Nov 03 17:14:06 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:06 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5" returned: 0 in 0.261s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.975s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-235830641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4270a962-edfc-4a62-bfe6-dc3b5c48d1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4db197c06c4b1bacf3e26911bf9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:02Z,use_quota=True,user_id='c9a0eb106f9b48a0bfe6a3c4db4fc0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Creating volume 4270a962-edfc-4a62-bfe6-dc3b5c48d1c7 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:06 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:06 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f39f2338-12a4-449e-983a-c8393c6ed8fe" returned: 0 in 0.297s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:06 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7 1073741824
Nov 03 17:14:06 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-quobyte-f39f2338-12a4-449e-983a-c8393c6ed8fe" released by "delete_volume" :: held 0.816s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Attempting download of b5c6598b-f350-4a2b-a990-bb60e98720f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5c6598b-f350-4a2b-a990-bb60e98720f4', 'metadata': {}}])) to volume dd62cd34-f748-4d83-8db4-4a51bc49a7a5. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8efda18-a357-4bf1-b2d8-5f3db356938c]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5c6598b-f350-4a2b-a990-bb60e98720f4_rbwfvvr_ {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Created reservations ['577d3574-87c0-4b9d-9775-8697bcdd7559', '914033ee-7bc0-4416-8ad3-c683d35acee0', '4c335842-f519-4b47-8739-f64c5c8297ff', '1be75f58-7e4d-4e11-b5eb-589730f3175a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:06 devstack sudo[107037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5c6598b-f350-4a2b-a990-bb60e98720f4_rbwfvvr_
Nov 03 17:14:06 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:06 devstack sudo[107038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:06 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "cinder-153c7a7f-fe62-452b-a2e4-49c177679f7b-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-153c7a7f-fe62-452b-a2e4-49c177679f7b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "cinder-quobyte-153c7a7f-fe62-452b-a2e4-49c177679f7b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-quobyte-153c7a7f-fe62-452b-a2e4-49c177679f7b" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[571edfcd-d1d1-405a-9504-157cf034779f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-153c7a7f-fe62-452b-a2e4-49c177679f7b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:07 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5c6598b-f350-4a2b-a990-bb60e98720f4_rbwfvvr_" returned: 0 in 0.447s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5c6598b-f350-4a2b-a990-bb60e98720f4_rbwfvvr_ {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:07 devstack sudo[107045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-153c7a7f-fe62-452b-a2e4-49c177679f7b
Nov 03 17:14:07 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:07 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.409s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:07 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Deleted volume successfully.
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7 1073741824" returned: 0 in 0.693s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:07 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5c6598b-f350-4a2b-a990-bb60e98720f4_rbwfvvr_
Nov 03 17:14:07 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d8494f8-a260-4094-9303-dc94bd85459e tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-f39f2338-12a4-449e-983a-c8393c6ed8fe-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:07 devstack sudo[107052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7
Nov 03 17:14:07 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:07 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-153c7a7f-fe62-452b-a2e4-49c177679f7b" returned: 0 in 0.441s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-153c7a7f-fe62-452b-a2e4-49c177679f7b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:07 devstack sudo[107057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-153c7a7f-fe62-452b-a2e4-49c177679f7b
Nov 03 17:14:07 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:07 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5c6598b-f350-4a2b-a990-bb60e98720f4_rbwfvvr_" returned: 1 in 0.410s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5c6598b-f350-4a2b-a990-bb60e98720f4_rbwfvvr_' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e812916d-fd3f-42d3-acbb-f18564b15b53]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:07 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.714s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1318793401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dae2900-89a6-406d-b23a-511bef20702e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4db197c06c4b1bacf3e26911bf9d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:03Z,use_quota=True,user_id='c9a0eb106f9b48a0bfe6a3c4db4fc0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Creating volume 3dae2900-89a6-406d-b23a-511bef20702e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:07 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3dae2900-89a6-406d-b23a-511bef20702e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbea838-4223-4099-a5be-01dee000021c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:07 devstack sudo[107063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3dae2900-89a6-406d-b23a-511bef20702e 1073741824
Nov 03 17:14:07 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878b3ef0-8db5-4400-abf7-32e79cd8196b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:07 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7 (4270a962-edfc-4a62-bfe6-dc3b5c48d1c7): created successfully
Nov 03 17:14:07 devstack sudo[107062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD
Nov 03 17:14:07 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878b3ef0-8db5-4400-abf7-32e79cd8196b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Flow 'volume_create_manager' (406b082b-c570-4af1-92ea-ec12b3fa1833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fefb1068-fb12-4c17-9675-218850cf8efb tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Created volume successfully.
Nov 03 17:14:07 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-153c7a7f-fe62-452b-a2e4-49c177679f7b" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-quobyte-153c7a7f-fe62-452b-a2e4-49c177679f7b" released by "delete_volume" :: held 0.778s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Created reservations ['b23ac9b6-b28a-4b50-8fc9-bfc9d4929c3a', '5e35a1bd-30e8-497e-b07b-ed8943965388', '5fa58a1d-a142-46e6-80fb-fb271301ff51', '61274af0-d2d7-442c-a1ef-035950c6e338'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:07 devstack sudo[107072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:07 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:07 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:08 devstack sudo[107074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD
Nov 03 17:14:08 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "cinder-bd25f37e-b61f-4daa-86e9-8b21cb2e2980-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-bd25f37e-b61f-4daa-86e9-8b21cb2e2980-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:08 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3dae2900-89a6-406d-b23a-511bef20702e 1073741824" returned: 0 in 0.619s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:08 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.350s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Deleted volume successfully.
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "cinder-quobyte-bd25f37e-b61f-4daa-86e9-8b21cb2e2980" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3dae2900-89a6-406d-b23a-511bef20702e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-quobyte-bd25f37e-b61f-4daa-86e9-8b21cb2e2980" acquired by "delete_volume" :: waited 0.049s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:08 devstack sudo[107079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3dae2900-89a6-406d-b23a-511bef20702e
Nov 03 17:14:08 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a50de5c9-cfcf-4802-9572-2731fbd8f60b tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-153c7a7f-fe62-452b-a2e4-49c177679f7b-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[44335260-82b6-4b55-a160-38c7c20280ae]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:08 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD" returned: 1 in 0.539s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] b5c6598b-f350-4a2b-a990-bb60e98720f4 was raw, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:08 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5
Nov 03 17:14:08 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:08 devstack sudo[107081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980
Nov 03 17:14:08 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:08 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3dae2900-89a6-406d-b23a-511bef20702e" returned: 0 in 0.316s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.579s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af827ed1-beb4-42c4-b41b-6ddfe32251c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f8abe3a8674ae590c5501e6e7c7332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:01Z,use_quota=True,user_id='28078ef9c06e413db555e429d7381bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15cc12aa-8950-433f-8304-7da5592abcd2),volume_type_id=15cc12aa-8950-433f-8304-7da5592abcd2)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Creating volume af827ed1-beb4-42c4-b41b-6ddfe32251c4 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:08 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3086dc33-07e4-4c02-b3b6-0c474794a733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dae2900-89a6-406d-b23a-511bef20702e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfd5c62-1389-406d-8774-c66eea444fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:08 devstack sudo[107089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4 1073741824
Nov 03 17:14:08 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:08 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Volume volume-3dae2900-89a6-406d-b23a-511bef20702e (3dae2900-89a6-406d-b23a-511bef20702e): created successfully
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfd5c62-1389-406d-8774-c66eea444fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Flow 'volume_create_manager' (80eba4ae-33f6-485e-848b-8dfc55724aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ef366c42-2603-4eef-b92f-05e413059190 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Created volume successfully.
Nov 03 17:14:08 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980" returned: 0 in 0.441s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:08 devstack sudo[107098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980
Nov 03 17:14:08 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:08 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5" returned: 0 in 0.499s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5c6598b-f350-4a2b-a990-bb60e98720f4_3dd044gjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:14:08 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 17:14:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:08 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5 1G
Nov 03 17:14:08 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:09 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-bd25f37e-b61f-4daa-86e9-8b21cb2e2980" returned: 0 in 0.308s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-quobyte-bd25f37e-b61f-4daa-86e9-8b21cb2e2980" released by "delete_volume" :: held 0.842s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:09 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4 1073741824" returned: 0 in 0.606s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Created reservations ['d6646f17-71c3-4a6a-9ed9-fc56fe40d90b', '0eb71e50-28aa-4cce-a3ab-d9d7af6afad2', '8acaf04b-e35d-470b-851c-126fdeb7275a', '328ed3dc-e817-4a64-8896-6bf4f67ef00a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:09 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4
Nov 03 17:14:09 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:09 devstack sudo[107111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:09 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:09 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5 1G" returned: 0 in 0.466s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Downloaded image b5c6598b-f350-4a2b-a990-bb60e98720f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5c6598b-f350-4a2b-a990-bb60e98720f4', 'metadata': {}}])) to volume dd62cd34-f748-4d83-8db4-4a51bc49a7a5 successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Temporary image b5c6598b-f350-4a2b-a990-bb60e98720f4 for user beb8a3f00822418186ce609aee9983d7 is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Marking volume dd62cd34-f748-4d83-8db4-4a51bc49a7a5 as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Copying metadata from image b5c6598b-f350-4a2b-a990-bb60e98720f4 to dd62cd34-f748-4d83-8db4-4a51bc49a7a5. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Creating volume glance metadata for volume dd62cd34-f748-4d83-8db4-4a51bc49a7a5 backed by image b5c6598b-f350-4a2b-a990-bb60e98720f4 with: {'image_id': 'b5c6598b-f350-4a2b-a990-bb60e98720f4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '345a72fa91b6a4a831b34207185cd8df', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "cinder-3dae2900-89a6-406d-b23a-511bef20702e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-3dae2900-89a6-406d-b23a-511bef20702e-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd0dac7-d0e2-4e0e-8ad9-52570e2c48dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5', 'volume_size': 1, 'image_id': 'b5c6598b-f350-4a2b-a990-bb60e98720f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5c6598b-f350-4a2b-a990-bb60e98720f4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '345a72fa91b6a4a831b34207185cd8df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d0a88fd17c54764bd35e6db9bcb5833', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c93e3b05109454df935a0651a02cb326d1eca2e76b4b47fb8c261f1e7177ff63902c4b8d53cda5b647ae9a7f90f842331088ee99dde62719b54cab598d611dc', 'id': 'b5c6598b-f350-4a2b-a990-bb60e98720f4', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5c6598b-f350-4a2b-a990-bb60e98720f4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e723a85fc50>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec7d1d9-fafc-4ae0-9fcb-cc2c3438529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:09 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4" returned: 0 in 0.369s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "cinder-quobyte-3dae2900-89a6-406d-b23a-511bef20702e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:09 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Volume volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5 (dd62cd34-f748-4d83-8db4-4a51bc49a7a5): created successfully
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec7d1d9-fafc-4ae0-9fcb-cc2c3438529c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Flow 'volume_create_manager' (2c053853-99af-40cd-824f-3a92a814f200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f0a193c2-0c39-4e6c-90d2-c651567ff19b tempest-VolumeImageDependencyTests-2105061718 None] Created volume successfully.
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-quobyte-3dae2900-89a6-406d-b23a-511bef20702e" acquired by "delete_volume" :: waited 0.047s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Attempting download of a3e03e98-def9-46b0-9212-01c22f6c358f ((None, [{'url': 'file:///opt/stack/data/glance/images/a3e03e98-def9-46b0-9212-01c22f6c358f', 'metadata': {}}])) to volume af827ed1-beb4-42c4-b41b-6ddfe32251c4. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 17:14:09 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a50cc2e-771f-4c42-a4ed-978a0a6491b0]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3dae2900-89a6-406d-b23a-511bef20702e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Deleted volume successfully.
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8664e4-7017-49fc-ad3a-a098fdb4aeeb]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3e03e98-def9-46b0-9212-01c22f6c358f_0pxzayjk {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-872b5907-3166-4267-b27e-f73477f51d10 tempest-CreateVolumesFromImageTest-857003541 None] Lock "cinder-bd25f37e-b61f-4daa-86e9-8b21cb2e2980-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:09 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3dae2900-89a6-406d-b23a-511bef20702e
Nov 03 17:14:09 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:09 devstack sudo[107116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3e03e98-def9-46b0-9212-01c22f6c358f_0pxzayjk
Nov 03 17:14:09 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:10 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3dae2900-89a6-406d-b23a-511bef20702e" returned: 0 in 0.402s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3dae2900-89a6-406d-b23a-511bef20702e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:10 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3e03e98-def9-46b0-9212-01c22f6c358f_0pxzayjk" returned: 0 in 0.360s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3e03e98-def9-46b0-9212-01c22f6c358f_0pxzayjk {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:10 devstack sudo[107124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3dae2900-89a6-406d-b23a-511bef20702e
Nov 03 17:14:10 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Acquiring lock "cinder-dd62cd34-f748-4d83-8db4-4a51bc49a7a5-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Lock "cinder-dd62cd34-f748-4d83-8db4-4a51bc49a7a5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:10 devstack sudo[107125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3e03e98-def9-46b0-9212-01c22f6c358f_0pxzayjk
Nov 03 17:14:10 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Acquiring lock "cinder-quobyte-dd62cd34-f748-4d83-8db4-4a51bc49a7a5" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Lock "cinder-quobyte-dd62cd34-f748-4d83-8db4-4a51bc49a7a5" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[939f8c1d-5ca0-4679-859e-78e7351f9ea4]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:10 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3dae2900-89a6-406d-b23a-511bef20702e" returned: 0 in 0.350s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-quobyte-3dae2900-89a6-406d-b23a-511bef20702e" released by "delete_volume" :: held 0.813s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Created reservations ['aa8bed7c-26b9-4ad7-8835-f34e5500dc80', 'fb829ff0-ba02-4737-939e-d4028d5233f4', '7740adb7-c8e9-4af7-a1b2-4a75122857df', '57543d01-842a-43d7-b24c-413d73bf8da3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:10 devstack sudo[107135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5
Nov 03 17:14:10 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:10 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3e03e98-def9-46b0-9212-01c22f6c358f_0pxzayjk" returned: 1 in 0.544s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3e03e98-def9-46b0-9212-01c22f6c358f_0pxzayjk' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bacc07-c651-4b1f-912f-b242efe588a5]: (4, 'raw') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:10 devstack sudo[107140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:10 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "cinder-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:10 devstack sudo[107139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD
Nov 03 17:14:10 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "cinder-quobyte-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-quobyte-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a8b9d7-0664-4007-a975-b3e13d2a0730]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:11 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5" returned: 0 in 0.562s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:11 devstack sudo[107148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5
Nov 03 17:14:11 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:11 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7
Nov 03 17:14:11 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:11 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:11 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD" returned: 0 in 0.525s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.508s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Deleted volume successfully.
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2361fd83-9d10-4c9e-a9bb-078437e19990 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-3dae2900-89a6-406d-b23a-511bef20702e-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:11 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd62cd34-f748-4d83-8db4-4a51bc49a7a5" returned: 0 in 0.338s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Lock "cinder-quobyte-dd62cd34-f748-4d83-8db4-4a51bc49a7a5" released by "delete_volume" :: held 0.982s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:11 devstack sudo[107154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD
Nov 03 17:14:11 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Created reservations ['5f9a7207-791e-4a46-b93d-76c3f628e511', '85fcde2b-d5cc-4265-a875-5bc6d085fb11', 'a5d5d0c7-d367-400b-897b-1a82d282853f', '5bd4f52e-94ed-4d8e-b1e1-22dae641e622'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:11 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7" returned: 0 in 0.563s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:11 devstack sudo[107161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7
Nov 03 17:14:11 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:11 devstack sudo[107163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:11 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:11 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD" returned: 1 in 0.565s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] a3e03e98-def9-46b0-9212-01c22f6c358f was raw, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:11 devstack sudo[107168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4
Nov 03 17:14:11 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:11 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7" returned: 0 in 0.336s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-quobyte-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7" released by "delete_volume" :: held 0.958s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:11 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.387s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:11 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Deleted volume successfully.
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Created reservations ['ae75a615-2445-4139-93ee-30251c9f2a92', 'c792a9ad-50c9-484a-85eb-3ddf44b566bf', 'bf704fde-2a7b-432e-8938-07163a4c1b22', '69991143-2312-48e3-b77d-25c7ec66ea0f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a58e7f36-4eda-46a8-8bce-ed686afbf78b tempest-VolumeImageDependencyTests-2105061718 None] Lock "cinder-dd62cd34-f748-4d83-8db4-4a51bc49a7a5-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:12 devstack sudo[107175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:12 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:12 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4" returned: 0 in 0.676s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a3e03e98-def9-46b0-9212-01c22f6c358f_op66qs5adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:14:12 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:12 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.347s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:12 devstack sudo[107180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4 1G
Nov 03 17:14:12 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Deleted volume successfully.
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f1f6e02d-4773-4fcd-bafa-16093a3b0ec0 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-4270a962-edfc-4a62-bfe6-dc3b5c48d1c7-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:12 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4 1G" returned: 0 in 0.413s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Downloaded image a3e03e98-def9-46b0-9212-01c22f6c358f ((None, [{'url': 'file:///opt/stack/data/glance/images/a3e03e98-def9-46b0-9212-01c22f6c358f', 'metadata': {}}])) to volume af827ed1-beb4-42c4-b41b-6ddfe32251c4 successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Temporary image a3e03e98-def9-46b0-9212-01c22f6c358f for user 28078ef9c06e413db555e429d7381bc7 is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Marking volume af827ed1-beb4-42c4-b41b-6ddfe32251c4 as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Copying metadata from image a3e03e98-def9-46b0-9212-01c22f6c358f to af827ed1-beb4-42c4-b41b-6ddfe32251c4. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Creating volume glance metadata for volume af827ed1-beb4-42c4-b41b-6ddfe32251c4 backed by image a3e03e98-def9-46b0-9212-01c22f6c358f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a3e03e98-def9-46b0-9212-01c22f6c358f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd521310d18dbb9967add60870b8cfa30', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15b9dfd-ed6a-4608-8861-d8af5f3507a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4', 'volume_size': 1, 'image_id': 'a3e03e98-def9-46b0-9212-01c22f6c358f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3e03e98-def9-46b0-9212-01c22f6c358f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd521310d18dbb9967add60870b8cfa30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06f8abe3a8674ae590c5501e6e7c7332', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7178b34c7ecbd5a8eea2ca7778e7801429c423e6502f0b398b5cb6dfad100c814eb82bcd93bfff9065e206f985fbd6a59dd8de213745de8fbf61c6aeb3a2e77a', 'id': 'a3e03e98-def9-46b0-9212-01c22f6c358f', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3e03e98-def9-46b0-9212-01c22f6c358f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e7245142660>}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a455dc9-18c5-4b61-8c63-52c8090f6ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:13 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Volume volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4 (af827ed1-beb4-42c4-b41b-6ddfe32251c4): created successfully
Nov 03 17:14:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a455dc9-18c5-4b61-8c63-52c8090f6ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Flow 'volume_create_manager' (154ed8a5-3d2d-413c-a5d3-cdc6af29d98e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-841cae7d-d120-4f45-94f2-4fe5954b9a82 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Created volume successfully.
Nov 03 17:14:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "cinder-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "cinder-quobyte-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-quobyte-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:13 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2becce-3345-4ad8-a05e-4a542904f144]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:13 devstack sudo[107186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa
Nov 03 17:14:13 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:13 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa" returned: 0 in 0.445s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:13 devstack sudo[107191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa
Nov 03 17:14:13 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Acquiring lock "cinder-af827ed1-beb4-42c4-b41b-6ddfe32251c4-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Lock "cinder-af827ed1-beb4-42c4-b41b-6ddfe32251c4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Acquiring lock "cinder-quobyte-af827ed1-beb4-42c4-b41b-6ddfe32251c4" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:14 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa" returned: 0 in 0.520s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Lock "cinder-quobyte-af827ed1-beb4-42c4-b41b-6ddfe32251c4" acquired by "delete_volume" :: waited 0.047s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-quobyte-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa" released by "delete_volume" :: held 1.054s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cf1204-9121-4995-adfd-059a4f94adc1]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Created reservations ['e06f2fd5-2306-42ff-83e6-c101f485fe12', '78b8f0ec-7a3e-4496-aa66-413f355ffcd5', '91976108-0440-46a1-83b8-a5093de36b89', '3830205b-5a5b-4527-a446-cce90361b887'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:14 devstack sudo[107194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4
Nov 03 17:14:14 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:14 devstack sudo[107196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:14 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:14 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.331s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:14 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4" returned: 0 in 0.544s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Deleted volume successfully.
Nov 03 17:14:14 devstack sudo[107202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4
Nov 03 17:14:14 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8117d6f-fe76-4a95-b092-d0000847cc7f tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-c3c50f8d-3ef5-4a11-9ff0-3a4a5cbdf7fa-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:15 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af827ed1-beb4-42c4-b41b-6ddfe32251c4" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Lock "cinder-quobyte-af827ed1-beb4-42c4-b41b-6ddfe32251c4" released by "delete_volume" :: held 0.888s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Created reservations ['7d54c4e8-dd9a-4393-b30f-a7e5634476a6', 'd06e8169-e1ee-4251-950b-7f05abbc173d', '508fb6bb-2804-4bfe-829c-63fa211dd6c3', '2297aaaf-43bb-49f8-9b35-391645a9e63e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:15 devstack sudo[107205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:15 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "cinder-2a70ee48-c3af-4c99-a0c0-f9858e14525d-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-2a70ee48-c3af-4c99-a0c0-f9858e14525d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "cinder-quobyte-2a70ee48-c3af-4c99-a0c0-f9858e14525d" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-quobyte-2a70ee48-c3af-4c99-a0c0-f9858e14525d" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:15 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.336s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f547700a-dfb1-4d84-9528-ff86d92b9aaa]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Deleted volume successfully.
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c62daf1c-9e4f-4011-a9b3-5129c1c5af58 tempest-VolumeAndVolumeTypeFromImageTest-290596132 None] Lock "cinder-af827ed1-beb4-42c4-b41b-6ddfe32251c4-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Flow 'volume_create_manager' (9bb03b45-a8aa-4516-a04c-6a518440c669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4a9e61-9dcd-42b2-a280-6a808fa84f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4a9e61-9dcd-42b2-a280-6a808fa84f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-668554157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ab6729-959e-4923-8b45-132ca78b4be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a181fb8e10b24f95b7bf18f1d2cb9140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:16Z,use_quota=True,user_id='b174166fbcb14757b244e27d95dc59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:15 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d
Nov 03 17:14:15 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0a1478-43e4-4e58-b7aa-77117f4c519d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0a1478-43e4-4e58-b7aa-77117f4c519d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673c26c2-05c2-45c0-a6d3-56c61e3dc682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673c26c2-05c2-45c0-a6d3-56c61e3dc682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1ab6729-959e-4923-8b45-132ca78b4be4', 'volume_name': 'volume-c1ab6729-959e-4923-8b45-132ca78b4be4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39716cc3-bdb3-4ad7-a228-720e1a7f6a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39716cc3-bdb3-4ad7-a228-720e1a7f6a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209c3bbe-fee8-4a24-b41d-c2706a0903d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:15 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Volume c1ab6729-959e-4923-8b45-132ca78b4be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1ab6729-959e-4923-8b45-132ca78b4be4', 'volume_size': 1}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-668554157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ab6729-959e-4923-8b45-132ca78b4be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a181fb8e10b24f95b7bf18f1d2cb9140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:16Z,use_quota=True,user_id='b174166fbcb14757b244e27d95dc59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Creating volume c1ab6729-959e-4923-8b45-132ca78b4be4 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:15 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:15 devstack sudo[107210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4 1073741824
Nov 03 17:14:15 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:16 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d" returned: 0 in 0.447s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:16 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d
Nov 03 17:14:16 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:16 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4 1073741824" returned: 0 in 0.548s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:16 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-2a70ee48-c3af-4c99-a0c0-f9858e14525d" returned: 0 in 0.353s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:16 devstack sudo[107222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4
Nov 03 17:14:16 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-quobyte-2a70ee48-c3af-4c99-a0c0-f9858e14525d" released by "delete_volume" :: held 0.888s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Created reservations ['df40b93b-bcb6-423e-ba1c-1fb0848372d7', '77b213ce-2d57-4d8e-99ad-4327631870ab', '8af7be0d-0539-42bc-af3c-e9a7d01c84d7', 'b22d59f6-d4f8-4303-8019-1204b9b53682'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:16 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:16 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:16 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4" returned: 0 in 0.361s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209c3bbe-fee8-4a24-b41d-c2706a0903d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ab6729-959e-4923-8b45-132ca78b4be4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00c5648-92c0-4672-b513-09b7e3b37fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Volume volume-c1ab6729-959e-4923-8b45-132ca78b4be4 (c1ab6729-959e-4923-8b45-132ca78b4be4): created successfully
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00c5648-92c0-4672-b513-09b7e3b37fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Flow 'volume_create_manager' (9bb03b45-a8aa-4516-a04c-6a518440c669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f56d0004-1dae-4dda-a732-f6794f5047e8 tempest-VolumeDependencyTests-1850333239 None] Created volume successfully.
Nov 03 17:14:17 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.293s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:17 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Deleted volume successfully.
Nov 03 17:14:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-56896c04-9f8e-4985-9ac1-12d6bbab4399 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-2a70ee48-c3af-4c99-a0c0-f9858e14525d-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] Creating offline snapshot 41a58f65-95c6-4f5f-b050-621fa12337dc of volume c1ab6729-959e-4923-8b45-132ca78b4be4 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[499dbc36-1b63-4e19-888a-e591e27562a7]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "cinder-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "cinder-quobyte-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:18 devstack sudo[107228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4
Nov 03 17:14:18 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-quobyte-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3ec91f-643c-4106-9fb0-3ba6b1e25a23]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:18 devstack sudo[107230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad
Nov 03 17:14:18 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:18 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4" returned: 0 in 0.542s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:18 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc 1G
Nov 03 17:14:18 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Flow 'volume_create_manager' (0d0d31b3-4286-4690-a7bf-3c353564690f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822d7dd9-c187-493a-bee4-b72603385c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822d7dd9-c187-493a-bee4-b72603385c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1811468710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3931ed-88c5-46c3-a1c7-bc5430c4573b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06607f442aa646a0abcd4d2dac643351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:19Z,use_quota=True,user_id='88c0ab29b0aa4829ac407cc213f5a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b4b0c1-4c8d-49b5-9a1c-162bcbfb1c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b4b0c1-4c8d-49b5-9a1c-162bcbfb1c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b39d5cd-22d2-496b-8ee7-81f219d53d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b39d5cd-22d2-496b-8ee7-81f219d53d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af3931ed-88c5-46c3-a1c7-bc5430c4573b', 'volume_name': 'volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed8bdaa-252d-47b4-b2f4-853d58e615e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed8bdaa-252d-47b4-b2f4-853d58e615e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d26d911-d9d3-4230-bd2a-25377b68a249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:18 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Volume af3931ed-88c5-46c3-a1c7-bc5430c4573b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b', 'volume_size': 1}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:18 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad" returned: 0 in 0.549s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:18 devstack sudo[107242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad
Nov 03 17:14:18 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:19 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc 1G" returned: 0 in 0.518s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1ab6729-959e-4923-8b45-132ca78b4be4 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:19 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1ab6729-959e-4923-8b45-132ca78b4be4 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc
Nov 03 17:14:19 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:19 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad" returned: 0 in 0.326s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-quobyte-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad" released by "delete_volume" :: held 0.961s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Created reservations ['78caa23e-d8c2-48e8-bfe3-2ab8b84fe55d', 'e33831af-4122-4359-8c58-628196a6a4c9', 'a4cab4ef-37f0-4b05-aa27-464bf922184f', '14b052ac-db02-4e0d-b053-20f1d078e342'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:19 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:19 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:19 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1ab6729-959e-4923-8b45-132ca78b4be4 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc" returned: 0 in 0.389s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:19 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc is being set with open permissions: ugo+rw
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:19 devstack sudo[107253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc
Nov 03 17:14:19 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:19 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.321s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Deleted volume successfully.
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-45ff2f67-2485-4a16-99bc-832fccfd9d62 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-4f13ea92-2b54-4561-b5e7-6bd2dcf3faad-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:19 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc" returned: 0 in 0.368s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:19 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.info
Nov 03 17:14:19 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:20 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.info" returned: 0 in 0.330s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:20 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.info is being set with open permissions: ugo+rw
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:20 devstack sudo[107296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.info
Nov 03 17:14:20 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "cinder-a0845569-3c4e-400e-aeab-9bf06ed4506a-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-a0845569-3c4e-400e-aeab-9bf06ed4506a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "cinder-quobyte-a0845569-3c4e-400e-aeab-9bf06ed4506a" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:20 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.info" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.567s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.765s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1811468710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3931ed-88c5-46c3-a1c7-bc5430c4573b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06607f442aa646a0abcd4d2dac643351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:19Z,use_quota=True,user_id='88c0ab29b0aa4829ac407cc213f5a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Creating volume af3931ed-88c5-46c3-a1c7-bc5430c4573b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:20 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-quobyte-a0845569-3c4e-400e-aeab-9bf06ed4506a" acquired by "delete_volume" :: waited 0.086s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:20 devstack sudo[107299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b 1073741824
Nov 03 17:14:20 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e007cfbd-0b93-4376-b2c6-d9e758f1f3ea tempest-VolumeDependencyTests-1850333239 None] Create snapshot completed successfully
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d8febb-77cb-41b9-b9a4-227f92bae9ea]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a0845569-3c4e-400e-aeab-9bf06ed4506a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:20 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a0845569-3c4e-400e-aeab-9bf06ed4506a
Nov 03 17:14:20 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:21 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a0845569-3c4e-400e-aeab-9bf06ed4506a" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a0845569-3c4e-400e-aeab-9bf06ed4506a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:21 devstack sudo[107311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a0845569-3c4e-400e-aeab-9bf06ed4506a
Nov 03 17:14:21 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:21 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b 1073741824" returned: 0 in 0.571s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:21 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b
Nov 03 17:14:21 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:21 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a0845569-3c4e-400e-aeab-9bf06ed4506a" returned: 0 in 0.296s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-quobyte-a0845569-3c4e-400e-aeab-9bf06ed4506a" released by "delete_volume" :: held 0.783s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Created reservations ['4fcfae72-15dc-46d4-a81c-fc33d663559a', 'e3fe821c-c9b8-4edf-82b8-f29ccd383de3', 'd1f9a250-7721-494f-a260-00b86573e123', '0167e50d-fa84-4d78-820c-7bc1f291d106'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:21 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b" returned: 0 in 0.311s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d26d911-d9d3-4230-bd2a-25377b68a249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17632d9-1cb7-4d5d-8045-d3df9e1342fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:21 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Volume volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b (af3931ed-88c5-46c3-a1c7-bc5430c4573b): created successfully
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17632d9-1cb7-4d5d-8045-d3df9e1342fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Flow 'volume_create_manager' (0d0d31b3-4286-4690-a7bf-3c353564690f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9702077f-11c5-4cad-9276-2dd0ca910cc1 tempest-ProjectReaderTests-1319724341 None] Created volume successfully.
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:21 devstack sudo[107317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:21 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:21 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:22 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Flow 'volume_create_manager' (094a5d4e-ae8c-461d-b83a-a97f1f35bc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8086173b-cc5e-45f9-a0ce-110d27e3b555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.427s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Deleted volume successfully.
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8086173b-cc5e-45f9-a0ce-110d27e3b555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-474688233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff0144f-e457-4657-867b-5ba1d8378b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a181fb8e10b24f95b7bf18f1d2cb9140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41a58f65-95c6-4f5f-b050-621fa12337dc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:22Z,use_quota=True,user_id='b174166fbcb14757b244e27d95dc59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df69dcb-98c9-4f8c-a578-483391f4f74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df69dcb-98c9-4f8c-a578-483391f4f74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e1ad2a-af08-4611-bb63-d64b337317c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e1ad2a-af08-4611-bb63-d64b337317c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0ff0144f-e457-4657-867b-5ba1d8378b95', 'volume_name': 'volume-0ff0144f-e457-4657-867b-5ba1d8378b95', 'volume_size': 1, 'snapshot_id': '41a58f65-95c6-4f5f-b050-621fa12337dc'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669a80c6-44df-4232-bafd-37dc1b5c1fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669a80c6-44df-4232-bafd-37dc1b5c1fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f84e1b-6e4a-40de-a18e-6da4fca84df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Volume 0ff0144f-e457-4657-867b-5ba1d8378b95: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0ff0144f-e457-4657-867b-5ba1d8378b95', 'volume_size': 1, 'snapshot_id': '41a58f65-95c6-4f5f-b050-621fa12337dc'}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "cinder-quobyte-41a58f65-95c6-4f5f-b050-621fa12337dc-0ff0144f-e457-4657-867b-5ba1d8378b95" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-18a8f13f-9cc3-4712-8e40-f3d59eb4c460 tempest-CreateVolumesFromSourceVolumeTest-1626252705 None] Lock "cinder-a0845569-3c4e-400e-aeab-9bf06ed4506a-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-quobyte-41a58f65-95c6-4f5f-b050-621fa12337dc-0ff0144f-e457-4657-867b-5ba1d8378b95" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Creating volume 0ff0144f-e457-4657-867b-5ba1d8378b95 from snapshot 41a58f65-95c6-4f5f-b050-621fa12337dc {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "cinder-quobyte-0ff0144f-e457-4657-867b-5ba1d8378b95" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-quobyte-0ff0144f-e457-4657-867b-5ba1d8378b95" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] snapshot: 41a58f65-95c6-4f5f-b050-621fa12337dc, volume: 0ff0144f-e457-4657-867b-5ba1d8378b95,  {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b770b0-005f-40cb-8f75-2643ead24173]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:22 devstack sudo[107321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc
Nov 03 17:14:22 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Flow 'volume_create_manager' (b5c5b6d9-b375-41bf-b533-6d8d3eb72fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d48174-8eb0-4398-b45c-3bddb1cceb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d48174-8eb0-4398-b45c-3bddb1cceb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-541603579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc57d1ad-979e-4bba-a05a-a0d641de0aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c285805cca4e2c9e0711ee4c03da95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:23Z,use_quota=True,user_id='93519afec2164a2485777469dee65da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa79463-0f69-43c1-b656-446783f8c642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa79463-0f69-43c1-b656-446783f8c642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3f0caf-aec4-418b-bf6d-766006cd0ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3f0caf-aec4-418b-bf6d-766006cd0ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc57d1ad-979e-4bba-a05a-a0d641de0aa6', 'volume_name': 'volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4db190d-045f-42c0-b19c-0191650678c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4db190d-045f-42c0-b19c-0191650678c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229c0351-5834-4808-ad32-123c8a36801a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume dc57d1ad-979e-4bba-a05a-a0d641de0aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6', 'volume_size': 1}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:22 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc" returned: 0 in 0.436s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1ab6729-959e-4923-8b45-132ca78b4be4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3c908d-492c-4ca6-97cf-78f11e2e5d54]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:22 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4
Nov 03 17:14:22 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:23 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4" returned: 0 in 0.405s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 17:14:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 17:14:23 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Path /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 17:14:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:23 devstack sudo[107332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95
Nov 03 17:14:23 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:26 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Flow 'volume_create_manager' (a8bacb65-062e-4018-8a9c-99455fdbb01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f080c6-f88d-4e74-91a3-083778430e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f080c6-f88d-4e74-91a3-083778430e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba02c69a-0fdc-46da-9222-c0cd8a958302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f1a952154b40c2bfc04c8e97faec35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:26Z,use_quota=True,user_id='663f5b6546a34c4f99b0155a6dd717f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75394dc6-a512-4045-a316-3d9ae04ed44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75394dc6-a512-4045-a316-3d9ae04ed44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ead3e33-1100-4aef-a51b-1270b2e822b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ead3e33-1100-4aef-a51b-1270b2e822b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba02c69a-0fdc-46da-9222-c0cd8a958302', 'volume_name': 'volume-ba02c69a-0fdc-46da-9222-c0cd8a958302', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78079e41-357a-483c-9b5a-91b1aaf0b268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78079e41-357a-483c-9b5a-91b1aaf0b268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e132d5-56d8-4639-87f4-40cbccf104cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Volume ba02c69a-0fdc-46da-9222-c0cd8a958302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba02c69a-0fdc-46da-9222-c0cd8a958302', 'volume_size': 1}
Nov 03 17:14:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:29 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95" returned: 0 in 6.619s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:29 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:14:29 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Converted 1024.00 MB image at 154.69 MB/s
Nov 03 17:14:29 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95 is being set with open permissions: ugo+rw
Nov 03 17:14:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:29 devstack sudo[107347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95
Nov 03 17:14:29 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:30 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95" returned: 0 in 0.272s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-quobyte-0ff0144f-e457-4657-867b-5ba1d8378b95" released by "_copy_volume_from_snapshot" :: held 7.851s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-quobyte-41a58f65-95c6-4f5f-b050-621fa12337dc-0ff0144f-e457-4657-867b-5ba1d8378b95" released by "_create_volume_from_snapshot" :: held 7.996s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.033s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] Creating offline snapshot 012fb85a-6bb1-48f5-a461-bb53707bf648 of volume af3931ed-88c5-46c3-a1c7-bc5430c4573b {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f84e1b-6e4a-40de-a18e-6da4fca84df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff0144f-e457-4657-867b-5ba1d8378b95', 'volume_size': 1, 'snapshot_id': '41a58f65-95c6-4f5f-b050-621fa12337dc'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63632f6-3b97-48e2-829c-5327ad013218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c4d9c0-f508-457e-8dbe-496ea83a4d40]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:30 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Volume volume-0ff0144f-e457-4657-867b-5ba1d8378b95 (0ff0144f-e457-4657-867b-5ba1d8378b95): created successfully
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63632f6-3b97-48e2-829c-5327ad013218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Flow 'volume_create_manager' (094a5d4e-ae8c-461d-b83a-a97f1f35bc77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:30 devstack sudo[107350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b
Nov 03 17:14:30 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:30 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-edfe374d-4ebe-4880-bc6c-6f5f9bbddda4 tempest-VolumeDependencyTests-1850333239 None] Created volume successfully.
Nov 03 17:14:30 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b" returned: 0 in 0.386s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "cinder-41a58f65-95c6-4f5f-b050-621fa12337dc-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:30 devstack sudo[107355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648 1G
Nov 03 17:14:30 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-41a58f65-95c6-4f5f-b050-621fa12337dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "cinder-quobyte-c1ab6729-959e-4923-8b45-132ca78b4be4" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-quobyte-c1ab6729-959e-4923-8b45-132ca78b4be4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "cinder-quobyte-41a58f65-95c6-4f5f-b050-621fa12337dc" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-quobyte-41a58f65-95c6-4f5f-b050-621fa12337dc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Deleting offline snapshot 41a58f65-95c6-4f5f-b050-621fa12337dc of volume c1ab6729-959e-4923-8b45-132ca78b4be4 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] snapshot_file for this snap is: volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc0bdd9-8d19-4081-8393-8895b7c764c5]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:30 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc
Nov 03 17:14:30 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:31 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648 1G" returned: 0 in 0.455s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:31 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc" returned: 0 in 0.369s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1ab6729-959e-4923-8b45-132ca78b4be4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:14:31 devstack sudo[107367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648
Nov 03 17:14:31 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d978d4f-f192-4dc5-b5e1-f6795c8d1169]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:31 devstack sudo[107369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4
Nov 03 17:14:31 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:31 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648" returned: 0 in 0.326s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:31 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648 is being set with open permissions: ugo+rw
Nov 03 17:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:31 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648
Nov 03 17:14:31 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:31 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:31 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4" returned: 0 in 0.583s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:31 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.info
Nov 03 17:14:31 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:31 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc
Nov 03 17:14:31 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:32 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.info" returned: 0 in 0.270s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:32 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.info is being set with open permissions: ugo+rw
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:32 devstack sudo[107388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.info
Nov 03 17:14:32 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:32 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc" returned: 0 in 0.352s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:32 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc
Nov 03 17:14:32 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:32 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.info" returned: 0 in 0.293s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.666s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-541603579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc57d1ad-979e-4bba-a05a-a0d641de0aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c285805cca4e2c9e0711ee4c03da95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:23Z,use_quota=True,user_id='93519afec2164a2485777469dee65da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Creating volume dc57d1ad-979e-4bba-a05a-a0d641de0aa6 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:32 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:32 devstack sudo[107394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6 1073741824
Nov 03 17:14:32 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fd5aaf23-64ea-4289-8945-627039e0a7d6 tempest-ProjectReaderTests-1319724341 None] Create snapshot completed successfully
Nov 03 17:14:32 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4.41a58f65-95c6-4f5f-b050-621fa12337dc" returned: 0 in 0.318s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-quobyte-41a58f65-95c6-4f5f-b050-621fa12337dc" released by "_delete_snapshot" :: held 1.736s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-quobyte-c1ab6729-959e-4923-8b45-132ca78b4be4" released by "delete_snapshot" :: held 1.761s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Created reservations ['65d49bd9-dd3d-46c4-8ab1-69caef210c2e', 'a49339fc-3cd1-4901-8946-1c1bb24ed3d0', 'f453941d-380b-4f4f-b80f-adda66966f59', '54476c35-e26a-48e0-a6ef-8bb7940621f9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Delete snapshot completed successfully.
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b30d284b-fd35-4700-9c7c-60b28e37b34a tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-41a58f65-95c6-4f5f-b050-621fa12337dc-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "cinder-c1ab6729-959e-4923-8b45-132ca78b4be4-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:32 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6 1073741824" returned: 0 in 0.549s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-c1ab6729-959e-4923-8b45-132ca78b4be4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-012fb85a-6bb1-48f5-a461-bb53707bf648-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-012fb85a-6bb1-48f5-a461-bb53707bf648-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-af3931ed-88c5-46c3-a1c7-bc5430c4573b" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-af3931ed-88c5-46c3-a1c7-bc5430c4573b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-012fb85a-6bb1-48f5-a461-bb53707bf648" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "cinder-quobyte-c1ab6729-959e-4923-8b45-132ca78b4be4" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:33 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6
Nov 03 17:14:33 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-quobyte-c1ab6729-959e-4923-8b45-132ca78b4be4" acquired by "delete_volume" :: waited 0.036s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-012fb85a-6bb1-48f5-a461-bb53707bf648" acquired by "_delete_snapshot" :: waited 0.075s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Deleting offline snapshot 012fb85a-6bb1-48f5-a461-bb53707bf648 of volume af3931ed-88c5-46c3-a1c7-bc5430c4573b {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] snapshot_file for this snap is: volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4be2f5-4c9b-405e-a2d5-cb1abf3b8800]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aa24f1-f62a-48a1-bac9-9d326e98ac9e]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:33 devstack sudo[107403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4
Nov 03 17:14:33 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:33 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648
Nov 03 17:14:33 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:33 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6" returned: 0 in 0.298s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.942s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba02c69a-0fdc-46da-9222-c0cd8a958302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f1a952154b40c2bfc04c8e97faec35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:26Z,use_quota=True,user_id='663f5b6546a34c4f99b0155a6dd717f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Creating volume ba02c69a-0fdc-46da-9222-c0cd8a958302 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:33 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ba02c69a-0fdc-46da-9222-c0cd8a958302 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229c0351-5834-4808-ad32-123c8a36801a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:33 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ba02c69a-0fdc-46da-9222-c0cd8a958302 1073741824
Nov 03 17:14:33 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1238be12-5495-408e-8d66-8c523c1db903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6 (dc57d1ad-979e-4bba-a05a-a0d641de0aa6): created successfully
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1238be12-5495-408e-8d66-8c523c1db903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Flow 'volume_create_manager' (b5c5b6d9-b375-41bf-b533-6d8d3eb72fc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-45d9b923-a4bd-4fcc-b967-d2b6314e8265 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Created volume successfully.
Nov 03 17:14:33 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4" returned: 0 in 0.435s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:33 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648" returned: 0 in 0.440s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:14:33 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4
Nov 03 17:14:33 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff71bba-6844-43f8-8608-db1d0b3d30c0]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:33 devstack sudo[107420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b
Nov 03 17:14:33 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:33 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ba02c69a-0fdc-46da-9222-c0cd8a958302 1073741824" returned: 0 in 0.545s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ba02c69a-0fdc-46da-9222-c0cd8a958302 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:33 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-c1ab6729-959e-4923-8b45-132ca78b4be4" returned: 0 in 0.358s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:33 devstack sudo[107425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ba02c69a-0fdc-46da-9222-c0cd8a958302
Nov 03 17:14:33 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-quobyte-c1ab6729-959e-4923-8b45-132ca78b4be4" released by "delete_volume" :: held 0.879s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Created reservations ['984a7784-ebdf-4fdc-b6ab-5b2e0394f495', '8692e735-f649-4059-a9ca-3089c4e13033', '662f6bc4-5f00-4615-aca2-e726608e30c0', 'efec3f7f-e567-4a18-9a33-0177015bdd04'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:34 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b" returned: 0 in 0.434s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:34 devstack sudo[107430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648
Nov 03 17:14:34 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:34 devstack sudo[107432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:34 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:34 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ba02c69a-0fdc-46da-9222-c0cd8a958302" returned: 0 in 0.333s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e132d5-56d8-4639-87f4-40cbccf104cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba02c69a-0fdc-46da-9222-c0cd8a958302', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac58cda-9b36-4e77-b2c6-e2fff0896cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:34 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Volume volume-ba02c69a-0fdc-46da-9222-c0cd8a958302 (ba02c69a-0fdc-46da-9222-c0cd8a958302): created successfully
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac58cda-9b36-4e77-b2c6-e2fff0896cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Flow 'volume_create_manager' (a8bacb65-062e-4018-8a9c-99455fdbb01c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ff6954ef-7f35-407a-8a77-3b8e68b52092 tempest-CinderUnicodeTest-171555955 None] Created volume successfully.
Nov 03 17:14:34 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.308s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Deleted volume successfully.
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fcc172c7-e0f5-407d-9617-ede16d1ee797 tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-c1ab6729-959e-4923-8b45-132ca78b4be4-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:34 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648" returned: 0 in 0.436s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:34 devstack sudo[107439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648
Nov 03 17:14:34 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:34 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b.012fb85a-6bb1-48f5-a461-bb53707bf648" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-012fb85a-6bb1-48f5-a461-bb53707bf648" released by "_delete_snapshot" :: held 1.735s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] Creating offline snapshot d4965e84-5341-44c2-a59c-e982a09c449c of volume dc57d1ad-979e-4bba-a05a-a0d641de0aa6 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-af3931ed-88c5-46c3-a1c7-bc5430c4573b" released by "delete_snapshot" :: held 1.837s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eff60a3-05a4-43b6-af1b-162c66f37145]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:34 devstack sudo[107442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6
Nov 03 17:14:34 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:34 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Created reservations ['227c782e-b511-46ac-8928-f7f10e6119ee', '6f946af1-f2f0-48d0-a4fa-c41bbaa687b6', 'df49fbe3-5c11-45b8-b1c7-27557e44e627', 'b1d003b0-b517-4485-8aef-e8017ae92c40'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Delete snapshot completed successfully.
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea88cc6-0f04-4cc9-b984-7eb7a639a3d4 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-012fb85a-6bb1-48f5-a461-bb53707bf648-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-af3931ed-88c5-46c3-a1c7-bc5430c4573b-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Lock "cinder-af3931ed-88c5-46c3-a1c7-bc5430c4573b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "cinder-0ff0144f-e457-4657-867b-5ba1d8378b95-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-0ff0144f-e457-4657-867b-5ba1d8378b95-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-af3931ed-88c5-46c3-a1c7-bc5430c4573b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-af3931ed-88c5-46c3-a1c7-bc5430c4573b" acquired by "delete_volume" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:35 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "cinder-quobyte-0ff0144f-e457-4657-867b-5ba1d8378b95" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6" returned: 0 in 0.641s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3855854-1d85-4c31-a382-f9a0db59845a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:35 devstack sudo[107449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c 1G
Nov 03 17:14:35 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-quobyte-0ff0144f-e457-4657-867b-5ba1d8378b95" acquired by "delete_volume" :: waited 0.049s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Flow 'volume_create_manager' (dddb2227-96d5-484c-9ad8-63e9b825f3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3393b4e7-a45b-433f-b8e4-540316d004b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6d738d-59a0-42fb-a4cc-933d2b379a96]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3393b4e7-a45b-433f-b8e4-540316d004b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1865825466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7abd15-867c-425a-a7f1-6f22a1a92e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f1a952154b40c2bfc04c8e97faec35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:35Z,use_quota=True,user_id='663f5b6546a34c4f99b0155a6dd717f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7661db82-2fe0-4618-87bb-bf22acc65795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7661db82-2fe0-4618-87bb-bf22acc65795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:35 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b
Nov 03 17:14:35 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bb3792-3c32-44a8-9798-7fbf8ad861ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bb3792-3c32-44a8-9798-7fbf8ad861ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc7abd15-867c-425a-a7f1-6f22a1a92e2d', 'volume_name': 'volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73931d99-d740-4fe7-91aa-508bd947b339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73931d99-d740-4fe7-91aa-508bd947b339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1db30b9-43af-46c5-a2f2-2b65f703b13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:35 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Volume cc7abd15-867c-425a-a7f1-6f22a1a92e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d', 'volume_size': 1}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:35 devstack sudo[107452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95
Nov 03 17:14:35 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:35 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c 1G" returned: 0 in 0.454s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:35 devstack sudo[107462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c
Nov 03 17:14:35 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:36 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b" returned: 0 in 0.466s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:36 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b
Nov 03 17:14:36 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:36 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95" returned: 0 in 0.469s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:36 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95
Nov 03 17:14:36 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:36 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:36 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c" returned: 0 in 0.324s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:36 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c is being set with open permissions: ugo+rw
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-af3931ed-88c5-46c3-a1c7-bc5430c4573b" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:36 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c
Nov 03 17:14:36 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-af3931ed-88c5-46c3-a1c7-bc5430c4573b" released by "delete_volume" :: held 0.887s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:36 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-0ff0144f-e457-4657-867b-5ba1d8378b95" returned: 0 in 0.285s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Created reservations ['d545809a-684a-4c69-b474-5dd0c9627efc', '81d6cdcf-760d-4880-b53b-1ce43b7188e6', 'fe647374-f291-4784-9750-401e7655a83f', 'e77ffe0f-c239-499c-bae4-da1843fc593f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-quobyte-0ff0144f-e457-4657-867b-5ba1d8378b95" released by "delete_volume" :: held 0.858s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Created reservations ['1e4fd0ae-a29b-444a-98bf-838104a20f68', '513290c8-032c-4975-ac1e-3d99d2c0fd62', '681adf6a-7856-4d06-8012-8441f355fd58', '4a9cd11a-9b00-44a6-9ec8-0d36efc53363'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:36 devstack sudo[107478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:36 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:36 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c" returned: 0 in 0.354s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:36 devstack sudo[107481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:36 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:36 devstack sudo[107483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.info
Nov 03 17:14:36 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:36 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Deleted volume successfully.
Nov 03 17:14:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c62b68e-7518-438f-bacf-8ad6127a9c7a tempest-ProjectReaderTests-1319724341 None] Lock "cinder-af3931ed-88c5-46c3-a1c7-bc5430c4573b-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:37 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.353s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Deleted volume successfully.
Nov 03 17:14:37 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c77a66ac-bd17-4433-be98-50c3d47c7dd4 tempest-VolumeDependencyTests-1850333239 None] Lock "cinder-0ff0144f-e457-4657-867b-5ba1d8378b95-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.info" returned: 0 in 0.368s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:37 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.info is being set with open permissions: ugo+rw
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:37 devstack sudo[107488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.info
Nov 03 17:14:37 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Flow 'volume_create_manager' (4426873c-c575-457c-b0eb-94414df1f143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81d46b5-f556-4431-81c0-be3cf586efeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81d46b5-f556-4431-81c0-be3cf586efeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887519167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970b8ca0-b6b0-429a-a60a-8a4865a42e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06607f442aa646a0abcd4d2dac643351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:37Z,use_quota=True,user_id='88c0ab29b0aa4829ac407cc213f5a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e342b70a-def5-4371-b31e-b8b5973222cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e342b70a-def5-4371-b31e-b8b5973222cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc97ff57-f68e-416d-876c-6ea3cb525424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc97ff57-f68e-416d-876c-6ea3cb525424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970b8ca0-b6b0-429a-a60a-8a4865a42e77', 'volume_name': 'volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:37 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2812c6-1063-4bb6-860f-a2f5fe2c5cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2812c6-1063-4bb6-860f-a2f5fe2c5cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a10ae77-a9e1-456b-9877-6e9ca967088d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:37 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Volume 970b8ca0-b6b0-429a-a60a-8a4865a42e77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77', 'volume_size': 1}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.info" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.669s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1865825466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7abd15-867c-425a-a7f1-6f22a1a92e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f1a952154b40c2bfc04c8e97faec35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:35Z,use_quota=True,user_id='663f5b6546a34c4f99b0155a6dd717f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Creating volume cc7abd15-867c-425a-a7f1-6f22a1a92e2d {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:37 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:37 devstack sudo[107491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d 1073741824
Nov 03 17:14:37 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b545184c-2b45-418c-824d-2759f640d18b tempest-CreateVolumesFromSnapshotTest-1847013375 None] Create snapshot completed successfully
Nov 03 17:14:37 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d 1073741824" returned: 0 in 0.449s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:37 devstack sudo[107497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d
Nov 03 17:14:37 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:38 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d" returned: 0 in 0.299s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887519167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970b8ca0-b6b0-429a-a60a-8a4865a42e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06607f442aa646a0abcd4d2dac643351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:37Z,use_quota=True,user_id='88c0ab29b0aa4829ac407cc213f5a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Creating volume 970b8ca0-b6b0-429a-a60a-8a4865a42e77 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:38 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1db30b9-43af-46c5-a2f2-2b65f703b13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:38 devstack sudo[107500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77 1073741824
Nov 03 17:14:38 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737f4151-9e70-40ca-80b6-6196bcd7cd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:38 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Volume volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d (cc7abd15-867c-425a-a7f1-6f22a1a92e2d): created successfully
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737f4151-9e70-40ca-80b6-6196bcd7cd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Flow 'volume_create_manager' (dddb2227-96d5-484c-9ad8-63e9b825f3c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7599b3f1-effe-47a5-8fe0-402cdea4d4ae tempest-CinderUnicodeTest-171555955 None] Created volume successfully.
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Flow 'volume_create_manager' (75e36814-2f53-402b-93ba-bdb99421ec9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871e901a-0e05-4334-8444-fd5e678ab120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871e901a-0e05-4334-8444-fd5e678ab120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-892092367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fbb8c9-a71f-494b-ba4f-37f706eda7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c285805cca4e2c9e0711ee4c03da95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:39Z,use_quota=True,user_id='93519afec2164a2485777469dee65da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3252fe18-b447-41e4-94e3-3440f0079acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3252fe18-b447-41e4-94e3-3440f0079acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a9ab40-ca04-4874-900f-86152d05c3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a9ab40-ca04-4874-900f-86152d05c3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81fbb8c9-a71f-494b-ba4f-37f706eda7ba', 'volume_name': 'volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af574704-8d5f-40b7-97fa-3fe50be4efb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:38 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af574704-8d5f-40b7-97fa-3fe50be4efb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbda5888-9afa-41f9-9f1f-3d07ac33ac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:38 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume 81fbb8c9-a71f-494b-ba4f-37f706eda7ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba', 'volume_size': 1}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77 1073741824" returned: 0 in 0.736s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:39 devstack sudo[107506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77
Nov 03 17:14:39 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:39 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Flow 'volume_create_manager' (1714ef3f-69f3-419f-bee4-22c2c5b60cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ea9332-10b3-4713-ad6a-bebd95daab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77" returned: 0 in 0.574s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.645s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-892092367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fbb8c9-a71f-494b-ba4f-37f706eda7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c285805cca4e2c9e0711ee4c03da95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:39Z,use_quota=True,user_id='93519afec2164a2485777469dee65da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Creating volume 81fbb8c9-a71f-494b-ba4f-37f706eda7ba {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:39 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ea9332-10b3-4713-ad6a-bebd95daab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-827642664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b3557f-ddcd-4a35-8526-c8915422f090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c285805cca4e2c9e0711ee4c03da95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:39Z,use_quota=True,user_id='93519afec2164a2485777469dee65da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:39 devstack sudo[107509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba 1073741824
Nov 03 17:14:39 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3a6182-0b56-4d48-a146-8b092dc5ce23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3a6182-0b56-4d48-a146-8b092dc5ce23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f15db0f-0725-4ccc-a8d2-d52230792f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f15db0f-0725-4ccc-a8d2-d52230792f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b3557f-ddcd-4a35-8526-c8915422f090', 'volume_name': 'volume-f6b3557f-ddcd-4a35-8526-c8915422f090', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0a840e-e2ae-4a13-963d-1a4a6e4fa5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0a840e-e2ae-4a13-963d-1a4a6e4fa5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ac9733-77fe-4bec-885b-20993d4a424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume f6b3557f-ddcd-4a35-8526-c8915422f090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b3557f-ddcd-4a35-8526-c8915422f090', 'volume_size': 1}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a10ae77-a9e1-456b-9877-6e9ca967088d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1b808c-95ca-4095-8f3d-5c37d1b9e9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Volume volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77 (970b8ca0-b6b0-429a-a60a-8a4865a42e77): created successfully
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1b808c-95ca-4095-8f3d-5c37d1b9e9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Flow 'volume_create_manager' (4426873c-c575-457c-b0eb-94414df1f143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-86877c16-4213-413f-9b34-3bef7463cdfd tempest-ProjectReaderTests-1319724341 None] Created volume successfully.
Nov 03 17:14:39 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Flow 'volume_create_manager' (bf7e1120-e93f-423a-a223-a92e2c6064ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4dffb4-9d74-4fc0-87bc-af606a7de2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4dffb4-9d74-4fc0-87bc-af606a7de2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-814647629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a917a250-c194-4619-a635-222d4ca98f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c285805cca4e2c9e0711ee4c03da95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:40Z,use_quota=True,user_id='93519afec2164a2485777469dee65da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cdd4bd-2dc6-44c0-b68a-3ad09d579f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cdd4bd-2dc6-44c0-b68a-3ad09d579f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332bbd48-48f7-40da-b035-0afa50ebddc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332bbd48-48f7-40da-b035-0afa50ebddc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a917a250-c194-4619-a635-222d4ca98f84', 'volume_name': 'volume-a917a250-c194-4619-a635-222d4ca98f84', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153f25b4-b5d2-4655-a7f8-a900bd3ef93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153f25b4-b5d2-4655-a7f8-a900bd3ef93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e796fd21-4ce1-4551-ab68-b4ea2ad15a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume a917a250-c194-4619-a635-222d4ca98f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a917a250-c194-4619-a635-222d4ca98f84', 'volume_size': 1}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:40 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba 1073741824" returned: 0 in 0.751s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:40 devstack sudo[107515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba
Nov 03 17:14:40 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Flow 'volume_create_manager' (9ea6fd5e-d1a6-4e0e-a3de-0370b2952a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be44bbcb-8017-4dea-af96-6be9d2e15f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be44bbcb-8017-4dea-af96-6be9d2e15f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1314520728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94234ca2-f13c-48fc-8c2c-51cda804765e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c285805cca4e2c9e0711ee4c03da95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:40Z,use_quota=True,user_id='93519afec2164a2485777469dee65da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e17a4cb9-cb1b-4667-8518-eba08fe5da84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e17a4cb9-cb1b-4667-8518-eba08fe5da84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f365c18-acf8-49b4-8ee8-84905b841294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f365c18-acf8-49b4-8ee8-84905b841294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94234ca2-f13c-48fc-8c2c-51cda804765e', 'volume_name': 'volume-94234ca2-f13c-48fc-8c2c-51cda804765e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21f0c58-2e76-4fb3-9b00-1a311bdca725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21f0c58-2e76-4fb3-9b00-1a311bdca725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce0607f-8879-4a6f-b8b6-4ed9dc28da6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume 94234ca2-f13c-48fc-8c2c-51cda804765e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94234ca2-f13c-48fc-8c2c-51cda804765e', 'volume_size': 1}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:40 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba" returned: 0 in 0.397s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.298s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbda5888-9afa-41f9-9f1f-3d07ac33ac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21ac2c7-4965-492c-b707-3f430e11ad74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] Creating offline snapshot f7c754e8-eb78-4065-86f5-53679607527e of volume cc7abd15-867c-425a-a7f1-6f22a1a92e2d {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:14:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba (81fbb8c9-a71f-494b-ba4f-37f706eda7ba): created successfully
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21ac2c7-4965-492c-b707-3f430e11ad74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Flow 'volume_create_manager' (75e36814-2f53-402b-93ba-bdb99421ec9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[baca90dc-fe00-4823-910d-a8fd0962b81a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-887ed853-da03-4874-984f-0764be6589be tempest-CreateVolumesFromSnapshotTest-1847013375 None] Created volume successfully.
Nov 03 17:14:41 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d
Nov 03 17:14:41 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Flow 'volume_create_manager' (f2d142fa-4129-4f12-b70b-ccdff2f40f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b90b5f-3459-4a23-b30a-8246937ff4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b90b5f-3459-4a23-b30a-8246937ff4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1850713263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7fb080e-f49e-42a6-bf33-46f5e6fee02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c285805cca4e2c9e0711ee4c03da95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:41Z,use_quota=True,user_id='93519afec2164a2485777469dee65da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866ae22a-d014-42db-a1b2-6bae90881503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866ae22a-d014-42db-a1b2-6bae90881503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2816f577-99b0-4c57-9edd-f974db69a0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2816f577-99b0-4c57-9edd-f974db69a0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7fb080e-f49e-42a6-bf33-46f5e6fee02c', 'volume_name': 'volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c175e0d1-017b-445e-8e35-d8aed7f8e587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c175e0d1-017b-445e-8e35-d8aed7f8e587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6082cf12-efe3-410d-a2b3-9965c9c3b0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume b7fb080e-f49e-42a6-bf33-46f5e6fee02c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c', 'volume_size': 1}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:41 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d" returned: 0 in 0.445s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:41 devstack sudo[107525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e 1G
Nov 03 17:14:41 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:41 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e 1G" returned: 0 in 0.463s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:41 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e
Nov 03 17:14:41 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:42 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e" returned: 0 in 0.338s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:42 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e is being set with open permissions: ugo+rw
Nov 03 17:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:42 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e
Nov 03 17:14:42 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e8dc1ca-02c2-4356-876f-8dcd67fdf39a tempest-ProjectAdminTests-1430057976 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7029113769531, 'free_capacity_gb': 1773.7029113769531, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87122) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 03 17:14:42 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:42 devstack sudo[107539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.info
Nov 03 17:14:42 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:42 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.info" returned: 0 in 0.272s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:42 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.info is being set with open permissions: ugo+rw
Nov 03 17:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:42 devstack sudo[107542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.info
Nov 03 17:14:42 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:42 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.info" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.319s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-827642664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b3557f-ddcd-4a35-8526-c8915422f090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c285805cca4e2c9e0711ee4c03da95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:39Z,use_quota=True,user_id='93519afec2164a2485777469dee65da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Creating volume f6b3557f-ddcd-4a35-8526-c8915422f090 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:43 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f6b3557f-ddcd-4a35-8526-c8915422f090 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:43 devstack sudo[107547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f6b3557f-ddcd-4a35-8526-c8915422f090 1073741824
Nov 03 17:14:43 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-41f6aa74-e711-4edc-bac1-aa63d58d2c5c tempest-CinderUnicodeTest-171555955 None] Create snapshot completed successfully
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Acquiring lock "cinder-f7c754e8-eb78-4065-86f5-53679607527e-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Lock "cinder-f7c754e8-eb78-4065-86f5-53679607527e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Acquiring lock "cinder-quobyte-cc7abd15-867c-425a-a7f1-6f22a1a92e2d" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Lock "cinder-quobyte-cc7abd15-867c-425a-a7f1-6f22a1a92e2d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Acquiring lock "cinder-quobyte-f7c754e8-eb78-4065-86f5-53679607527e" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Lock "cinder-quobyte-f7c754e8-eb78-4065-86f5-53679607527e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Deleting offline snapshot f7c754e8-eb78-4065-86f5-53679607527e of volume cc7abd15-867c-425a-a7f1-6f22a1a92e2d {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] snapshot_file for this snap is: volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd416429-9696-4afe-b7fb-7645a57fefe6]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:43 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f6b3557f-ddcd-4a35-8526-c8915422f090 1073741824" returned: 0 in 0.571s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:43 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e
Nov 03 17:14:43 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f6b3557f-ddcd-4a35-8526-c8915422f090 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:43 devstack sudo[107555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f6b3557f-ddcd-4a35-8526-c8915422f090
Nov 03 17:14:43 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:43 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f6b3557f-ddcd-4a35-8526-c8915422f090" returned: 0 in 0.287s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:43 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.827s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-814647629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a917a250-c194-4619-a635-222d4ca98f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c285805cca4e2c9e0711ee4c03da95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:40Z,use_quota=True,user_id='93519afec2164a2485777469dee65da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Creating volume a917a250-c194-4619-a635-222d4ca98f84 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:43 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a917a250-c194-4619-a635-222d4ca98f84 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e" returned: 0 in 0.471s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:14:44 devstack sudo[107561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a917a250-c194-4619-a635-222d4ca98f84 1073741824
Nov 03 17:14:44 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ac9733-77fe-4bec-885b-20993d4a424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b3557f-ddcd-4a35-8526-c8915422f090', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94528c4-6fb9-4648-9323-3fda3a13756f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cdebbf-4fae-47cd-a05b-c2c525c3f7d0]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:44 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume volume-f6b3557f-ddcd-4a35-8526-c8915422f090 (f6b3557f-ddcd-4a35-8526-c8915422f090): created successfully
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94528c4-6fb9-4648-9323-3fda3a13756f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Flow 'volume_create_manager' (1714ef3f-69f3-419f-bee4-22c2c5b60cb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9ee09b40-b41a-4101-a54b-3524b914fb6a tempest-CreateVolumesFromSnapshotTest-1847013375 None] Created volume successfully.
Nov 03 17:14:44 devstack sudo[107563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d
Nov 03 17:14:44 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:44 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a917a250-c194-4619-a635-222d4ca98f84 1073741824" returned: 0 in 0.595s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:44 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d" returned: 0 in 0.518s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:44 devstack sudo[107571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e
Nov 03 17:14:44 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a917a250-c194-4619-a635-222d4ca98f84 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:44 devstack sudo[107573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a917a250-c194-4619-a635-222d4ca98f84
Nov 03 17:14:44 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:44 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a917a250-c194-4619-a635-222d4ca98f84" returned: 0 in 0.267s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.267s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1314520728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94234ca2-f13c-48fc-8c2c-51cda804765e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c285805cca4e2c9e0711ee4c03da95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:40Z,use_quota=True,user_id='93519afec2164a2485777469dee65da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Creating volume 94234ca2-f13c-48fc-8c2c-51cda804765e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:44 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94234ca2-f13c-48fc-8c2c-51cda804765e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e796fd21-4ce1-4551-ab68-b4ea2ad15a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a917a250-c194-4619-a635-222d4ca98f84', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:44 devstack sudo[107580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94234ca2-f13c-48fc-8c2c-51cda804765e 1073741824
Nov 03 17:14:44 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8285b73a-5542-412f-a98e-91aad02be025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:44 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume volume-a917a250-c194-4619-a635-222d4ca98f84 (a917a250-c194-4619-a635-222d4ca98f84): created successfully
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8285b73a-5542-412f-a98e-91aad02be025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Flow 'volume_create_manager' (bf7e1120-e93f-423a-a223-a92e2c6064ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a27cecc0-8dda-4e0f-9982-7ebbc159bd99 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Created volume successfully.
Nov 03 17:14:45 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e" returned: 0 in 0.457s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:45 devstack sudo[107582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e
Nov 03 17:14:45 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:45 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d.f7c754e8-eb78-4065-86f5-53679607527e" returned: 0 in 0.352s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Lock "cinder-quobyte-f7c754e8-eb78-4065-86f5-53679607527e" released by "_delete_snapshot" :: held 1.987s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Lock "cinder-quobyte-cc7abd15-867c-425a-a7f1-6f22a1a92e2d" released by "delete_snapshot" :: held 2.023s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Created reservations ['0a9726b0-3cd5-4c2f-9c28-9bea67720aac', 'd35c3dea-fce8-4476-b918-bd588a024458', 'b46e942e-8bae-42eb-bd04-9824b212eec9', 'bea43c59-6e71-416a-82a6-5fc49d7404ff'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:45 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94234ca2-f13c-48fc-8c2c-51cda804765e 1073741824" returned: 0 in 0.716s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Delete snapshot completed successfully.
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-57265059-54f4-4c43-ad5f-4b039599355a tempest-CinderUnicodeTest-171555955 None] Lock "cinder-f7c754e8-eb78-4065-86f5-53679607527e-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94234ca2-f13c-48fc-8c2c-51cda804765e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:45 devstack sudo[107589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94234ca2-f13c-48fc-8c2c-51cda804765e
Nov 03 17:14:45 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:45 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94234ca2-f13c-48fc-8c2c-51cda804765e" returned: 0 in 0.272s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.825s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce0607f-8879-4a6f-b8b6-4ed9dc28da6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94234ca2-f13c-48fc-8c2c-51cda804765e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6131379-bd05-406c-84a9-d8f2c4014d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] Creating offline snapshot 3ed70591-655c-46eb-819c-8143eb9da938 of volume 970b8ca0-b6b0-429a-a60a-8a4865a42e77 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:14:46 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume volume-94234ca2-f13c-48fc-8c2c-51cda804765e (94234ca2-f13c-48fc-8c2c-51cda804765e): created successfully
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6131379-bd05-406c-84a9-d8f2c4014d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Flow 'volume_create_manager' (9ea6fd5e-d1a6-4e0e-a3de-0370b2952a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41195b1-3643-45f7-bf1e-19962936fbca]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f8dc86f2-2332-4bdd-bec3-f87b999ebbb9 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Created volume successfully.
Nov 03 17:14:46 devstack sudo[107592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77
Nov 03 17:14:46 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:46 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77" returned: 0 in 0.384s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:46 devstack sudo[107597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938 1G
Nov 03 17:14:46 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Acquiring lock "cinder-cc7abd15-867c-425a-a7f1-6f22a1a92e2d-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Lock "cinder-cc7abd15-867c-425a-a7f1-6f22a1a92e2d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Acquiring lock "cinder-quobyte-cc7abd15-867c-425a-a7f1-6f22a1a92e2d" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Lock "cinder-quobyte-cc7abd15-867c-425a-a7f1-6f22a1a92e2d" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[486cb0e1-2f27-4d50-a4a5-c2764eb8cb6d]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:46 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938 1G" returned: 0 in 0.536s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:46 devstack sudo[107604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938
Nov 03 17:14:46 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:46 devstack sudo[107603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d
Nov 03 17:14:46 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (3371a74d-1a4b-4a60-94da-37abe14c752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a966543f-4dea-4263-8650-d1eedff7e019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a966543f-4dea-4263-8650-d1eedff7e019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686089096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f2d645-9744-4ada-8290-3aa540cd6928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:47Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e967dadf-d77f-4d00-a6c6-d4d9c7e00efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e967dadf-d77f-4d00-a6c6-d4d9c7e00efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef23c8f9-08a9-4a4f-bd19-81d318d944ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef23c8f9-08a9-4a4f-bd19-81d318d944ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56f2d645-9744-4ada-8290-3aa540cd6928', 'volume_name': 'volume-56f2d645-9744-4ada-8290-3aa540cd6928', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054e3223-5486-4d40-bc5e-a1058e2c5301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:47 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054e3223-5486-4d40-bc5e-a1058e2c5301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b288510-42c1-4753-83cf-3960caa844d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:47 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Volume 56f2d645-9744-4ada-8290-3aa540cd6928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56f2d645-9744-4ada-8290-3aa540cd6928', 'volume_size': 1}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:47 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938 is being set with open permissions: ugo+rw
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:47 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d" returned: 0 in 0.459s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:47 devstack sudo[107613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938
Nov 03 17:14:47 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:47 devstack sudo[107614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d
Nov 03 17:14:47 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:47 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:47 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-cc7abd15-867c-425a-a7f1-6f22a1a92e2d" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Lock "cinder-quobyte-cc7abd15-867c-425a-a7f1-6f22a1a92e2d" released by "delete_volume" :: held 0.809s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:47 devstack sudo[107619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.info
Nov 03 17:14:47 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Created reservations ['abd3a8a5-7380-4c4f-b69f-8b8f360090d8', '27de4451-161e-4daa-ac42-a18c8ed05b9f', 'a6994a5f-c08a-49b6-8806-aec4602b2f15', '890c0ad3-4e22-49ba-80a1-751fd434ccc8'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:47 devstack sudo[107621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:47 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Acquiring lock "cinder-ba02c69a-0fdc-46da-9222-c0cd8a958302-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:47 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.info" returned: 0 in 0.296s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:47 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.info is being set with open permissions: ugo+rw
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Lock "cinder-ba02c69a-0fdc-46da-9222-c0cd8a958302-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:47 devstack sudo[107624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.info
Nov 03 17:14:47 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Acquiring lock "cinder-quobyte-ba02c69a-0fdc-46da-9222-c0cd8a958302" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Lock "cinder-quobyte-ba02c69a-0fdc-46da-9222-c0cd8a958302" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce298fce-5dc8-49f7-89ff-8f07babf86ee]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ba02c69a-0fdc-46da-9222-c0cd8a958302 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:48 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.302s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Deleted volume successfully.
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-175341f2-f091-4c46-936f-46e93fa854af tempest-CinderUnicodeTest-171555955 None] Lock "cinder-cc7abd15-867c-425a-a7f1-6f22a1a92e2d-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:48 devstack sudo[107627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ba02c69a-0fdc-46da-9222-c0cd8a958302
Nov 03 17:14:48 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:48 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.info" returned: 0 in 0.323s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.304s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.018s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1850713263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7fb080e-f49e-42a6-bf33-46f5e6fee02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c285805cca4e2c9e0711ee4c03da95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:41Z,use_quota=True,user_id='93519afec2164a2485777469dee65da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Creating volume b7fb080e-f49e-42a6-bf33-46f5e6fee02c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:48 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:48 devstack sudo[107630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c 1073741824
Nov 03 17:14:48 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1a5bad52-343b-4a5d-968d-ec0c4f839adb tempest-ProjectReaderTests-1319724341 None] Create snapshot completed successfully
Nov 03 17:14:48 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ba02c69a-0fdc-46da-9222-c0cd8a958302" returned: 0 in 0.429s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ba02c69a-0fdc-46da-9222-c0cd8a958302 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:48 devstack sudo[107635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ba02c69a-0fdc-46da-9222-c0cd8a958302
Nov 03 17:14:48 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:48 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c 1073741824" returned: 0 in 0.459s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:48 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ba02c69a-0fdc-46da-9222-c0cd8a958302" returned: 0 in 0.299s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:48 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c
Nov 03 17:14:48 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Lock "cinder-quobyte-ba02c69a-0fdc-46da-9222-c0cd8a958302" released by "delete_volume" :: held 0.791s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Created reservations ['7ac210f0-af3c-4cb9-93ee-d2f80fff8396', '7b12ec03-c5db-4a31-9598-624765ac27c3', '22104525-5ca0-49c7-94c0-0b9ef6a7db82', '423e39e2-d726-4dd4-9ee9-87dbbbd49d13'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:48 devstack sudo[107643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:48 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:49 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c" returned: 0 in 0.352s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.835s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686089096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f2d645-9744-4ada-8290-3aa540cd6928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:47Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Creating volume 56f2d645-9744-4ada-8290-3aa540cd6928 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:49 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6082cf12-efe3-410d-a2b3-9965c9c3b0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acaf08e5-4e87-44ef-8602-2da4c55d1bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:49 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Volume volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c (b7fb080e-f49e-42a6-bf33-46f5e6fee02c): created successfully
Nov 03 17:14:49 devstack sudo[107646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928 1073741824
Nov 03 17:14:49 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acaf08e5-4e87-44ef-8602-2da4c55d1bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Flow 'volume_create_manager' (f2d142fa-4129-4f12-b70b-ccdff2f40f06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ddf7167b-9f46-4a1e-86f3-44976ad18616 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Created volume successfully.
Nov 03 17:14:49 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.399s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Deleted volume successfully.
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-3ed70591-655c-46eb-819c-8143eb9da938-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a4035c73-78b9-4047-b399-075e16cc1454 tempest-CinderUnicodeTest-171555955 None] Lock "cinder-ba02c69a-0fdc-46da-9222-c0cd8a958302-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Lock "cinder-3ed70591-655c-46eb-819c-8143eb9da938-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-970b8ca0-b6b0-429a-a60a-8a4865a42e77" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-970b8ca0-b6b0-429a-a60a-8a4865a42e77" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-3ed70591-655c-46eb-819c-8143eb9da938" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-3ed70591-655c-46eb-819c-8143eb9da938" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Deleting offline snapshot 3ed70591-655c-46eb-819c-8143eb9da938 of volume 970b8ca0-b6b0-429a-a60a-8a4865a42e77 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] snapshot_file for this snap is: volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7eebb23-91a3-4bf6-8db9-e82f6e348f83]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:49 devstack sudo[107652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938
Nov 03 17:14:49 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:49 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928 1073741824" returned: 0 in 0.601s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:49 devstack sudo[107655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928
Nov 03 17:14:49 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-b7fb080e-f49e-42a6-bf33-46f5e6fee02c-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-b7fb080e-f49e-42a6-bf33-46f5e6fee02c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-quobyte-b7fb080e-f49e-42a6-bf33-46f5e6fee02c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-b7fb080e-f49e-42a6-bf33-46f5e6fee02c" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1196692-95dd-4a95-aebc-647eedf9a93c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:50 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938" returned: 0 in 0.568s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde4e3e6-7b4f-48af-8c39-7b5cbbfe82d2]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:50 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928" returned: 0 in 0.440s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b288510-42c1-4753-83cf-3960caa844d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56f2d645-9744-4ada-8290-3aa540cd6928', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25d9fd4-d8cd-4f6d-b977-e908a53e472a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:50 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Volume volume-56f2d645-9744-4ada-8290-3aa540cd6928 (56f2d645-9744-4ada-8290-3aa540cd6928): created successfully
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25d9fd4-d8cd-4f6d-b977-e908a53e472a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (3371a74d-1a4b-4a60-94da-37abe14c752c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:50 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c
Nov 03 17:14:50 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1b2aaead-2bb8-4502-a62e-283c74c74f0a tempest-ProjectMemberTests-1397646752 None] Created volume successfully.
Nov 03 17:14:50 devstack sudo[107662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77
Nov 03 17:14:50 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:50 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c" returned: 0 in 0.485s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:50 devstack sudo[107670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c
Nov 03 17:14:50 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:50 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77" returned: 0 in 0.490s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:50 devstack sudo[107674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938
Nov 03 17:14:50 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:50 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b7fb080e-f49e-42a6-bf33-46f5e6fee02c" returned: 0 in 0.333s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-b7fb080e-f49e-42a6-bf33-46f5e6fee02c" released by "delete_volume" :: held 0.883s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Created reservations ['14cc518e-2b2c-40d9-a0b9-a7d8d1d5acd0', '1f810c0c-26bd-406b-b2f5-e3cdad0058fb', 'a2406571-28dd-4b36-86a0-b477b69ae4b1', 'd5e4349a-2c33-4815-9345-a4a3826aea8b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:51 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938" returned: 0 in 0.489s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:51 devstack sudo[107683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938
Nov 03 17:14:51 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-94234ca2-f13c-48fc-8c2c-51cda804765e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:51 devstack sudo[107682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:51 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-94234ca2-f13c-48fc-8c2c-51cda804765e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-quobyte-94234ca2-f13c-48fc-8c2c-51cda804765e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-94234ca2-f13c-48fc-8c2c-51cda804765e" acquired by "delete_volume" :: waited 0.054s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24b5642-8965-4a28-8709-b5e8cb09dd11]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94234ca2-f13c-48fc-8c2c-51cda804765e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:51 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77.3ed70591-655c-46eb-819c-8143eb9da938" returned: 0 in 0.470s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:51 devstack sudo[107686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94234ca2-f13c-48fc-8c2c-51cda804765e
Nov 03 17:14:51 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:51 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.540s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-3ed70591-655c-46eb-819c-8143eb9da938" released by "_delete_snapshot" :: held 2.193s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Deleted volume successfully.
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-970b8ca0-b6b0-429a-a60a-8a4865a42e77" released by "delete_snapshot" :: held 2.234s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c25faa63-9bec-4bac-85a6-18a8411fc116 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-b7fb080e-f49e-42a6-bf33-46f5e6fee02c-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Created reservations ['014bcff1-4bd3-4146-b98d-314bba0a1c18', '0805f269-34ed-46c0-b751-5581e8b416dd', 'd61dc57e-16d7-4483-9dfa-04c0014902fb', 'bf071e74-07a9-4876-9b15-b9d812de4dac'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:51 devstack sudo[107690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:51 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Delete snapshot completed successfully.
Nov 03 17:14:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-601db433-f132-4023-9315-29cb32b6aaaf tempest-ProjectReaderTests-1319724341 None] Lock "cinder-3ed70591-655c-46eb-819c-8143eb9da938-delete_snapshot" released by "delete_snapshot" :: held 2.520s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:52 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94234ca2-f13c-48fc-8c2c-51cda804765e" returned: 0 in 0.610s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94234ca2-f13c-48fc-8c2c-51cda804765e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:52 devstack sudo[107696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94234ca2-f13c-48fc-8c2c-51cda804765e
Nov 03 17:14:52 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=261,cinder:SELECT=197,cinder:DELETE=23,cinder:INSERT=70 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:52 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.489s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] Creating offline snapshot d69c5e66-4a34-44a7-97a4-d18faac0ea50 of volume 56f2d645-9744-4ada-8290-3aa540cd6928 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 29 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>, <Thread(Rabbit-heartbeat, started daemon 139029247180864)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aa9fac-86fe-41aa-afe2-b2a9f8f524b0]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:52 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-94234ca2-f13c-48fc-8c2c-51cda804765e" returned: 0 in 0.381s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-94234ca2-f13c-48fc-8c2c-51cda804765e" released by "delete_volume" :: held 1.067s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=200,cinder:UPDATE=267,cinder:INSERT=72,cinder:DELETE=27 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:14:52 devstack sudo[107699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928
Nov 03 17:14:52 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Created reservations ['debabab9-760e-43ca-ab73-5d2694181daf', '44e90a87-dea5-4f64-9202-fff1151ce9d1', '98cc06d4-c510-43f3-927f-fc3424e1f74b', 'eb773d62-2a6c-4437-8c82-23f682baf607'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-970b8ca0-b6b0-429a-a60a-8a4865a42e77-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:52 devstack sudo[107702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:52 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-970b8ca0-b6b0-429a-a60a-8a4865a42e77-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-970b8ca0-b6b0-429a-a60a-8a4865a42e77" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-970b8ca0-b6b0-429a-a60a-8a4865a42e77" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5fb3b9-e1a2-4faf-8a59-bdc8eaea8a68]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:52 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928" returned: 0 in 0.557s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:53 devstack sudo[107708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50 1G
Nov 03 17:14:53 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:53 devstack sudo[107706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77
Nov 03 17:14:53 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:53 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.405s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Deleted volume successfully.
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-30cdffb4-ff6f-4d44-ac2f-d74aa1c2b2dd tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-94234ca2-f13c-48fc-8c2c-51cda804765e-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:53 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77" returned: 0 in 0.457s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:53 devstack sudo[107718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77
Nov 03 17:14:53 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:53 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50 1G" returned: 0 in 0.557s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56f2d645-9744-4ada-8290-3aa540cd6928 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:53 devstack sudo[107721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56f2d645-9744-4ada-8290-3aa540cd6928 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50
Nov 03 17:14:53 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:53 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-970b8ca0-b6b0-429a-a60a-8a4865a42e77" returned: 0 in 0.302s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-a917a250-c194-4619-a635-222d4ca98f84-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-970b8ca0-b6b0-429a-a60a-8a4865a42e77" released by "delete_volume" :: held 0.847s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-a917a250-c194-4619-a635-222d4ca98f84-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Created reservations ['a0eea88d-cb41-4b05-8e95-313938bedefc', '6ee50baa-a9d4-473d-9fcd-84b295db29ff', '7ec0d2ba-f8a7-42ea-9e74-b204db176269', '4c42dab9-77dd-461d-9aa6-8524545957c3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-quobyte-a917a250-c194-4619-a635-222d4ca98f84" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-a917a250-c194-4619-a635-222d4ca98f84" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[42669a35-814f-4d14-8edb-94ab83c7e80f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a917a250-c194-4619-a635-222d4ca98f84 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:53 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56f2d645-9744-4ada-8290-3aa540cd6928 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50" returned: 0 in 0.446s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:53 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50 is being set with open permissions: ugo+rw
Nov 03 17:14:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:54 devstack sudo[107727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a917a250-c194-4619-a635-222d4ca98f84
Nov 03 17:14:54 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:54 devstack sudo[107728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:54 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:54 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50
Nov 03 17:14:54 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:54 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a917a250-c194-4619-a635-222d4ca98f84" returned: 0 in 0.477s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a917a250-c194-4619-a635-222d4ca98f84 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:54 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50" returned: 0 in 0.382s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:54 devstack sudo[107738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a917a250-c194-4619-a635-222d4ca98f84
Nov 03 17:14:54 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:54 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.470s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Deleted volume successfully.
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ffec2f39-66f8-4092-a3e7-989403f17447 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-970b8ca0-b6b0-429a-a60a-8a4865a42e77-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:54 devstack sudo[107740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.info
Nov 03 17:14:54 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:54 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-a917a250-c194-4619-a635-222d4ca98f84" returned: 0 in 0.451s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-a917a250-c194-4619-a635-222d4ca98f84" released by "delete_volume" :: held 1.002s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Flow 'volume_create_manager' (e2f05077-c432-4686-abd7-d36004d6f4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:54 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9181d1a-b029-4850-9506-1ad5d8f7be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.info" returned: 0 in 0.427s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:54 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.info is being set with open permissions: ugo+rw
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:54 devstack sudo[107744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.info
Nov 03 17:14:54 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9181d1a-b029-4850-9506-1ad5d8f7be0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1869606123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de276d5-9db6-4a82-a246-210827858a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06607f442aa646a0abcd4d2dac643351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:55Z,use_quota=True,user_id='88c0ab29b0aa4829ac407cc213f5a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631f76a1-c918-4ce1-a33e-eaf17ecde468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631f76a1-c918-4ce1-a33e-eaf17ecde468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee5dae0-1558-4e90-9374-ff1f95162737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee5dae0-1558-4e90-9374-ff1f95162737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de276d5-9db6-4a82-a246-210827858a42', 'volume_name': 'volume-9de276d5-9db6-4a82-a246-210827858a42', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8274d465-9a22-450f-b111-aa893285a400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8274d465-9a22-450f-b111-aa893285a400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1d668f-306f-4329-8840-354f0c5f7ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Volume 9de276d5-9db6-4a82-a246-210827858a42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de276d5-9db6-4a82-a246-210827858a42', 'volume_size': 1}
Nov 03 17:14:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Created reservations ['6fba6121-120f-4575-8d7f-8e4a640e816c', 'fdd7c1ca-d124-444b-a5cf-a563df71a056', 'da5ad2fe-ea4f-4598-8f55-4c6bdbccde9f', '7b740e5a-898d-4cd8-adc0-d7883d1231f9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:55 devstack sudo[107746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:55 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:55 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.info" returned: 0 in 0.302s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.874s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.251s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1869606123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de276d5-9db6-4a82-a246-210827858a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06607f442aa646a0abcd4d2dac643351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:55Z,use_quota=True,user_id='88c0ab29b0aa4829ac407cc213f5a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Creating volume 9de276d5-9db6-4a82-a246-210827858a42 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:14:55 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:55 devstack sudo[107749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42 1073741824
Nov 03 17:14:55 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ef487041-1b35-4ad1-9bca-7f4663d4a9bc tempest-ProjectMemberTests-1397646752 None] Create snapshot completed successfully
Nov 03 17:14:55 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.304s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Deleted volume successfully.
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e16d45c3-57bf-4f28-aece-a39b78a481da tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-a917a250-c194-4619-a635-222d4ca98f84-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-d69c5e66-4a34-44a7-97a4-d18faac0ea50-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-d69c5e66-4a34-44a7-97a4-d18faac0ea50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-56f2d645-9744-4ada-8290-3aa540cd6928" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-56f2d645-9744-4ada-8290-3aa540cd6928" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-d69c5e66-4a34-44a7-97a4-d18faac0ea50" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-d69c5e66-4a34-44a7-97a4-d18faac0ea50" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Deleting offline snapshot d69c5e66-4a34-44a7-97a4-d18faac0ea50 of volume 56f2d645-9744-4ada-8290-3aa540cd6928 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] snapshot_file for this snap is: volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[067b2c66-8316-4691-891e-6b717cc710ab]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:55 devstack sudo[107755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50
Nov 03 17:14:55 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:55 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42 1073741824" returned: 0 in 0.569s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:55 devstack sudo[107758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42
Nov 03 17:14:55 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-f6b3557f-ddcd-4a35-8526-c8915422f090-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-f6b3557f-ddcd-4a35-8526-c8915422f090-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-quobyte-f6b3557f-ddcd-4a35-8526-c8915422f090" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-f6b3557f-ddcd-4a35-8526-c8915422f090" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9824d6ea-4f7c-40de-85e3-f6ec27525778]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f6b3557f-ddcd-4a35-8526-c8915422f090 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:56 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50" returned: 0 in 0.518s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56f2d645-9744-4ada-8290-3aa540cd6928(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e7d153-df93-449e-920b-2f74e9ee8c95]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:56 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42" returned: 0 in 0.386s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1d668f-306f-4329-8840-354f0c5f7ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de276d5-9db6-4a82-a246-210827858a42', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b48fde3-fb34-44d9-be62-073813901b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:14:56 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Volume volume-9de276d5-9db6-4a82-a246-210827858a42 (9de276d5-9db6-4a82-a246-210827858a42): created successfully
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b48fde3-fb34-44d9-be62-073813901b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Flow 'volume_create_manager' (e2f05077-c432-4686-abd7-d36004d6f4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:14:56 devstack sudo[107764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f6b3557f-ddcd-4a35-8526-c8915422f090
Nov 03 17:14:56 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:56 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-64cf9710-9e71-471b-bc74-af5cefca558f tempest-ProjectReaderTests-1319724341 None] Created volume successfully.
Nov 03 17:14:56 devstack sudo[107765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928
Nov 03 17:14:56 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:56 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f6b3557f-ddcd-4a35-8526-c8915422f090" returned: 0 in 0.482s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f6b3557f-ddcd-4a35-8526-c8915422f090 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:56 devstack sudo[107773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f6b3557f-ddcd-4a35-8526-c8915422f090
Nov 03 17:14:56 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:56 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928" returned: 0 in 0.494s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:56 devstack sudo[107776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50
Nov 03 17:14:56 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:56 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-f6b3557f-ddcd-4a35-8526-c8915422f090" returned: 0 in 0.353s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-f6b3557f-ddcd-4a35-8526-c8915422f090" released by "delete_volume" :: held 0.889s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Created reservations ['96ef9051-eca3-4384-81ec-fa30aec407db', '4f4a2eb5-3e5b-4dc2-b270-a0301cc011ab', '764adf65-fc11-4908-afa5-75dc95a0c38c', 'f9e20690-eb48-4dc0-81e0-43a964f2dfe4'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] Creating offline snapshot 02bfa815-665c-4502-9a5f-3304cde615e9 of volume 9de276d5-9db6-4a82-a246-210827858a42 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:14:57 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50" returned: 0 in 0.535s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6217293b-56d0-4c6a-8e25-3794af48ef93]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:57 devstack sudo[107782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50
Nov 03 17:14:57 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:57 devstack sudo[107785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:57 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:57 devstack sudo[107783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42
Nov 03 17:14:57 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:57 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928.d69c5e66-4a34-44a7-97a4-d18faac0ea50" returned: 0 in 0.469s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:57 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.349s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Deleted volume successfully.
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-d69c5e66-4a34-44a7-97a4-d18faac0ea50" released by "_delete_snapshot" :: held 2.170s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-56f2d645-9744-4ada-8290-3aa540cd6928" released by "delete_snapshot" :: held 2.199s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:57 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7f679d3a-e6f0-4d59-984f-f3bdd43db3a4 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-f6b3557f-ddcd-4a35-8526-c8915422f090-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42" returned: 0 in 0.538s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:57 devstack sudo[107793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9 1G
Nov 03 17:14:57 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Created reservations ['a76fb2f2-2362-4fca-af6d-96c9fddde349', '9494c60b-bd9a-4034-9429-cd9741c360fb', 'c0f49b2f-6d98-49e0-9fdd-c947bc65b23b', '9d406806-8083-494b-971c-2e5dcba06129'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Delete snapshot completed successfully.
Nov 03 17:14:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86544222-9a24-4793-93d4-ca4365b1e027 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-d69c5e66-4a34-44a7-97a4-d18faac0ea50-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:58 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9 1G" returned: 0 in 0.460s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9de276d5-9db6-4a82-a246-210827858a42 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:58 devstack sudo[107799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9de276d5-9db6-4a82-a246-210827858a42 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9
Nov 03 17:14:58 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-81fbb8c9-a71f-494b-ba4f-37f706eda7ba-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-81fbb8c9-a71f-494b-ba4f-37f706eda7ba-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-quobyte-81fbb8c9-a71f-494b-ba4f-37f706eda7ba" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-81fbb8c9-a71f-494b-ba4f-37f706eda7ba" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b59aeb-0e58-48df-824c-954d621a7360]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:58 devstack sudo[107801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba
Nov 03 17:14:58 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:58 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9de276d5-9db6-4a82-a246-210827858a42 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9" returned: 0 in 0.376s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:58 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9 is being set with open permissions: ugo+rw
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:58 devstack sudo[107806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9
Nov 03 17:14:58 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-56f2d645-9744-4ada-8290-3aa540cd6928-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Lock "cinder-56f2d645-9744-4ada-8290-3aa540cd6928-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-56f2d645-9744-4ada-8290-3aa540cd6928" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:58 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba" returned: 0 in 0.508s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:58 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-56f2d645-9744-4ada-8290-3aa540cd6928" acquired by "delete_volume" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:58 devstack sudo[107812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba
Nov 03 17:14:58 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9" returned: 0 in 0.365s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ce089f-9918-45d9-b0a2-497ee38568fd]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:59 devstack sudo[107815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.info
Nov 03 17:14:59 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:59 devstack sudo[107814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928
Nov 03 17:14:59 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:59 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-81fbb8c9-a71f-494b-ba4f-37f706eda7ba" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-81fbb8c9-a71f-494b-ba4f-37f706eda7ba" released by "delete_volume" :: held 0.879s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Created reservations ['0b07a33e-1dea-4fed-802f-ea52d346b0e6', '3ca41da9-c174-4d9c-8cfb-cdcda5100acf', '7f8bfbaf-fd34-480f-a5fb-cd60791a65a3', 'e3379702-c7f3-4767-83a7-e570369b2cd8'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:14:59 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.info" returned: 0 in 0.368s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:59 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.info is being set with open permissions: ugo+rw
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:59 devstack sudo[107820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.info
Nov 03 17:14:59 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-d4965e84-5341-44c2-a59c-e982a09c449c-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:59 devstack sudo[107825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:14:59 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-d4965e84-5341-44c2-a59c-e982a09c449c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-quobyte-dc57d1ad-979e-4bba-a05a-a0d641de0aa6" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-dc57d1ad-979e-4bba-a05a-a0d641de0aa6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-quobyte-d4965e84-5341-44c2-a59c-e982a09c449c" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-d4965e84-5341-44c2-a59c-e982a09c449c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:14:59 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Deleting offline snapshot d4965e84-5341-44c2-a59c-e982a09c449c of volume dc57d1ad-979e-4bba-a05a-a0d641de0aa6 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] snapshot_file for this snap is: volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928" returned: 0 in 0.604s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[553ed2b4-e60b-4aa4-921a-c8d1b5154b36]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:14:59 devstack sudo[107827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928
Nov 03 17:14:59 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:59 devstack sudo[107828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c
Nov 03 17:14:59 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:14:59 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.info" returned: 0 in 0.390s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.658s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:14:59 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.364s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:14:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Deleted volume successfully.
Nov 03 17:14:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-06ae1814-5a81-443b-ae81-66dcdd1dc6ff tempest-ProjectReaderTests-1319724341 None] Create snapshot completed successfully
Nov 03 17:14:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86413d5c-2c0d-4253-93bc-087bbd13cef7 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-81fbb8c9-a71f-494b-ba4f-37f706eda7ba-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:00 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-56f2d645-9744-4ada-8290-3aa540cd6928" returned: 0 in 0.368s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-56f2d645-9744-4ada-8290-3aa540cd6928" released by "delete_volume" :: held 1.075s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Created reservations ['f98d9178-1ab6-4d96-85c4-be4a453ce6f1', '75fe40e8-a782-4e30-a958-b1cdcf647a39', 'cf5c4d3b-a631-4144-aac9-a8eb11a23150', 'd725332d-ebbb-45a9-821a-fb23d429b30e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:00 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c" returned: 0 in 0.469s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[866d739b-c4b1-46b8-bf3b-017f5d182d80]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:00 devstack sudo[107839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:00 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:00 devstack sudo[107838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6
Nov 03 17:15:00 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-02bfa815-665c-4502-9a5f-3304cde615e9-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Lock "cinder-02bfa815-665c-4502-9a5f-3304cde615e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-9de276d5-9db6-4a82-a246-210827858a42" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-9de276d5-9db6-4a82-a246-210827858a42" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-02bfa815-665c-4502-9a5f-3304cde615e9" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-02bfa815-665c-4502-9a5f-3304cde615e9" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Deleting offline snapshot 02bfa815-665c-4502-9a5f-3304cde615e9 of volume 9de276d5-9db6-4a82-a246-210827858a42 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] snapshot_file for this snap is: volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:15:00 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.332s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a39b084-39f4-4bb8-b366-d7d1cd355b24]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:00 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Deleted volume successfully.
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2306cd42-6bc8-4509-af97-bdad9925fb5c tempest-ProjectMemberTests-1397646752 None] Lock "cinder-56f2d645-9744-4ada-8290-3aa540cd6928-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:00 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6" returned: 0 in 0.500s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:00 devstack sudo[107848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c
Nov 03 17:15:00 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:00 devstack sudo[107846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9
Nov 03 17:15:00 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:01 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9" returned: 0 in 0.463s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9de276d5-9db6-4a82-a246-210827858a42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e385b9-0393-4a17-8093-e47cd649fc6e]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:01 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c" returned: 0 in 0.440s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:01 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c
Nov 03 17:15:01 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:01 devstack sudo[107860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42
Nov 03 17:15:01 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:01 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6.d4965e84-5341-44c2-a59c-e982a09c449c" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-d4965e84-5341-44c2-a59c-e982a09c449c" released by "_delete_snapshot" :: held 1.892s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-dc57d1ad-979e-4bba-a05a-a0d641de0aa6" released by "delete_snapshot" :: held 1.927s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:01 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42" returned: 0 in 0.470s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:01 devstack sudo[107872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9
Nov 03 17:15:01 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Created reservations ['5da47f36-e2b0-425e-b7ca-9e6c38e05451', '858e4e10-3586-4bd2-b476-00450692d2c6', '85c9e3e5-180d-4711-b6b1-2fb1f2f63c6d', 'f65cf513-5c7a-4256-9e5d-496c42209303'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Delete snapshot completed successfully.
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ff37723e-0146-4d89-a1ec-1a70af085eeb tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-d4965e84-5341-44c2-a59c-e982a09c449c-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-dc57d1ad-979e-4bba-a05a-a0d641de0aa6-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-dc57d1ad-979e-4bba-a05a-a0d641de0aa6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (58322c98-6746-46ed-859e-e3ec903be180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588ebe86-d7a3-436c-9d9a-f19e3ecd6655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588ebe86-d7a3-436c-9d9a-f19e3ecd6655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537148064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3577a8e-5296-4ef9-beeb-346295c65ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:02Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5f8c2f-6199-4d43-b76f-40360324b897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5f8c2f-6199-4d43-b76f-40360324b897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ee0680-90de-4f45-a804-42e40ced51d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ee0680-90de-4f45-a804-42e40ced51d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3577a8e-5296-4ef9-beeb-346295c65ce0', 'volume_name': 'volume-d3577a8e-5296-4ef9-beeb-346295c65ce0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7636e4ea-29e4-4206-aa1a-9785ff5b3e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7636e4ea-29e4-4206-aa1a-9785ff5b3e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cd4607-bc41-4c12-9a2e-6305a2967e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:01 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Volume d3577a8e-5296-4ef9-beeb-346295c65ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3577a8e-5296-4ef9-beeb-346295c65ce0', 'volume_size': 1}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537148064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3577a8e-5296-4ef9-beeb-346295c65ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:02Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Creating volume d3577a8e-5296-4ef9-beeb-346295c65ce0 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:01 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "cinder-quobyte-dc57d1ad-979e-4bba-a05a-a0d641de0aa6" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:02 devstack sudo[107877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0 1073741824
Nov 03 17:15:02 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-dc57d1ad-979e-4bba-a05a-a0d641de0aa6" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:02 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9" returned: 0 in 0.541s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c137ce-727c-4810-a14f-7bd3c8f53455]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:02 devstack sudo[107881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9
Nov 03 17:15:02 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:02 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6
Nov 03 17:15:02 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:02 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42.02bfa815-665c-4502-9a5f-3304cde615e9" returned: 0 in 0.312s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-02bfa815-665c-4502-9a5f-3304cde615e9" released by "_delete_snapshot" :: held 1.930s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-9de276d5-9db6-4a82-a246-210827858a42" released by "delete_snapshot" :: held 1.978s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Created reservations ['6dd2ede2-72d8-4609-8744-98c4b80f5df6', '377fa966-bde7-4429-a50c-65c08539f6b3', '8efea440-46e2-46f8-b087-23e6bd301451', 'e5433a51-c04c-48f7-b755-d9a9f49f3499'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:02 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0 1073741824" returned: 0 in 0.661s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:02 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6" returned: 0 in 0.559s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Delete snapshot completed successfully.
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:02 devstack sudo[107893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6
Nov 03 17:15:02 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4faef077-9e2a-472b-ac6d-d12c68477aeb tempest-ProjectReaderTests-1319724341 None] Lock "cinder-02bfa815-665c-4502-9a5f-3304cde615e9-delete_snapshot" released by "delete_snapshot" :: held 2.284s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:02 devstack sudo[107894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0
Nov 03 17:15:02 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:03 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dc57d1ad-979e-4bba-a05a-a0d641de0aa6" returned: 0 in 0.319s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-quobyte-dc57d1ad-979e-4bba-a05a-a0d641de0aa6" released by "delete_volume" :: held 1.001s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:03 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0" returned: 0 in 0.341s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cd4607-bc41-4c12-9a2e-6305a2967e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3577a8e-5296-4ef9-beeb-346295c65ce0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fadacc-50ce-4dfb-a39f-3efa3f63c178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:03 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Volume volume-d3577a8e-5296-4ef9-beeb-346295c65ce0 (d3577a8e-5296-4ef9-beeb-346295c65ce0): created successfully
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fadacc-50ce-4dfb-a39f-3efa3f63c178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (58322c98-6746-46ed-859e-e3ec903be180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Created reservations ['7be4788b-bd84-42d2-b028-5ebc33cb29af', 'b02304c3-f26a-4b7c-8db6-fc5d6d4b9f07', 'c671f084-71a0-4e21-b015-000db6445921', '46a4cc12-78f2-460f-92ef-504fa8b92fa5'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2c5993cc-ccbc-46c7-b2ea-8c6eccbdf8b0 tempest-ProjectMemberTests-1397646752 None] Created volume successfully.
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:03 devstack sudo[107899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:03 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:03 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Deleted volume successfully.
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b1abb45f-a537-488b-ac6a-7c9671a0a6c0 tempest-CreateVolumesFromSnapshotTest-1847013375 None] Lock "cinder-dc57d1ad-979e-4bba-a05a-a0d641de0aa6-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-9de276d5-9db6-4a82-a246-210827858a42-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-9de276d5-9db6-4a82-a246-210827858a42-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-9de276d5-9db6-4a82-a246-210827858a42" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-9de276d5-9db6-4a82-a246-210827858a42" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9252e198-18b2-430c-a98b-f10774a9db0c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:03 devstack sudo[107902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42
Nov 03 17:15:03 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] Creating offline snapshot dd3f8c1a-cf53-4e26-9123-bd7554bc59d7 of volume d3577a8e-5296-4ef9-beeb-346295c65ce0 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6b9a2f-3bc5-42af-82fa-084922e27118]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:04 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42" returned: 0 in 0.484s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:04 devstack sudo[107908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42
Nov 03 17:15:04 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:04 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0
Nov 03 17:15:04 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:04 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9de276d5-9db6-4a82-a246-210827858a42" returned: 0 in 0.332s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-9de276d5-9db6-4a82-a246-210827858a42" released by "delete_volume" :: held 0.898s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:04 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0" returned: 0 in 0.526s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:04 devstack sudo[107915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7 1G
Nov 03 17:15:04 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Created reservations ['b9920999-31a4-4d84-b185-58d0e9636111', 'a2a5f5ea-f4ce-4450-b89e-62c1d390e686', '55bc46d3-4112-401a-8900-a1d61b601e97', '77b6f0b6-0c58-465b-b3b7-e04a599c0d42'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:04 devstack sudo[107917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:04 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:05 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7 1G" returned: 0 in 0.608s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3577a8e-5296-4ef9-beeb-346295c65ce0 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:05 devstack sudo[107924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3577a8e-5296-4ef9-beeb-346295c65ce0 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7
Nov 03 17:15:05 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:05 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.524s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:05 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Deleted volume successfully.
Nov 03 17:15:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-16a496a2-0577-4b2b-8213-1b1ed8406b99 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-9de276d5-9db6-4a82-a246-210827858a42-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:05 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3577a8e-5296-4ef9-beeb-346295c65ce0 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:05 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7 is being set with open permissions: ugo+rw
Nov 03 17:15:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:05 devstack sudo[107930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7
Nov 03 17:15:05 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:05 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7" returned: 0 in 0.288s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:06 devstack sudo[107933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.info
Nov 03 17:15:06 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:06 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.info" returned: 0 in 0.338s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:06 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.info is being set with open permissions: ugo+rw
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:06 devstack sudo[107936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.info
Nov 03 17:15:06 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:06 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.info" returned: 0 in 0.303s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.542s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Flow 'volume_create_manager' (3cae5caf-1da9-4046-9a4a-02427406bfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6783f436-a8fe-439b-bfd8-0e39e24fc527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e40f8cf4-37c5-4f75-88ad-b093ee6c41e0 tempest-ProjectMemberTests-1397646752 None] Create snapshot completed successfully
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6783f436-a8fe-439b-bfd8-0e39e24fc527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-334341975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a72742-5968-43d1-9f39-e54fd7104267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06607f442aa646a0abcd4d2dac643351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:07Z,use_quota=True,user_id='88c0ab29b0aa4829ac407cc213f5a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4349c70a-4fca-483b-9748-f4bcb7825e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4349c70a-4fca-483b-9748-f4bcb7825e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec92afc-7419-47b5-979a-1d542a4972b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec92afc-7419-47b5-979a-1d542a4972b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a72742-5968-43d1-9f39-e54fd7104267', 'volume_name': 'volume-82a72742-5968-43d1-9f39-e54fd7104267', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34674d1a-7746-470e-b0b7-a07e32629fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34674d1a-7746-470e-b0b7-a07e32629fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb9cc13-3a79-44eb-b8ee-ba1463559f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Volume 82a72742-5968-43d1-9f39-e54fd7104267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a72742-5968-43d1-9f39-e54fd7104267', 'volume_size': 1}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-334341975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a72742-5968-43d1-9f39-e54fd7104267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06607f442aa646a0abcd4d2dac643351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:07Z,use_quota=True,user_id='88c0ab29b0aa4829ac407cc213f5a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Creating volume 82a72742-5968-43d1-9f39-e54fd7104267 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:06 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:06 devstack sudo[107939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267 1073741824
Nov 03 17:15:06 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-dd3f8c1a-cf53-4e26-9123-bd7554bc59d7-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-dd3f8c1a-cf53-4e26-9123-bd7554bc59d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-d3577a8e-5296-4ef9-beeb-346295c65ce0" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:07 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267 1073741824" returned: 0 in 0.629s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-d3577a8e-5296-4ef9-beeb-346295c65ce0" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-dd3f8c1a-cf53-4e26-9123-bd7554bc59d7" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-dd3f8c1a-cf53-4e26-9123-bd7554bc59d7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Deleting offline snapshot dd3f8c1a-cf53-4e26-9123-bd7554bc59d7 of volume d3577a8e-5296-4ef9-beeb-346295c65ce0 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] snapshot_file for this snap is: volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ca0b67-433e-436a-83d7-c5f8cd7a7b33]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:07 devstack sudo[107946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267
Nov 03 17:15:07 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:07 devstack sudo[107945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7
Nov 03 17:15:07 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:07 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267" returned: 0 in 0.307s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb9cc13-3a79-44eb-b8ee-ba1463559f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a72742-5968-43d1-9f39-e54fd7104267', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725bfcda-7281-491d-9303-888411f2bd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:07 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Volume volume-82a72742-5968-43d1-9f39-e54fd7104267 (82a72742-5968-43d1-9f39-e54fd7104267): created successfully
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725bfcda-7281-491d-9303-888411f2bd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Flow 'volume_create_manager' (3cae5caf-1da9-4046-9a4a-02427406bfc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9dc94cd8-a76b-428d-ae55-1cff8ad30ca1 tempest-ProjectReaderTests-1319724341 None] Created volume successfully.
Nov 03 17:15:08 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7" returned: 0 in 0.501s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3577a8e-5296-4ef9-beeb-346295c65ce0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:15:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a27576-0bb0-4448-a868-456f45ea096f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:08 devstack sudo[107953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0
Nov 03 17:15:08 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:08 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0" returned: 0 in 0.467s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:08 devstack sudo[107958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7
Nov 03 17:15:08 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] Creating offline snapshot 3c939e86-42c5-4443-ba53-e191c2f0792e of volume 82a72742-5968-43d1-9f39-e54fd7104267 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:15:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a93681d-b738-40a4-9bf4-36305c777282]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:09 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7" returned: 0 in 0.553s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:09 devstack sudo[107965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7
Nov 03 17:15:09 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:09 devstack sudo[107964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267
Nov 03 17:15:09 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:09 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0.dd3f8c1a-cf53-4e26-9123-bd7554bc59d7" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-dd3f8c1a-cf53-4e26-9123-bd7554bc59d7" released by "_delete_snapshot" :: held 2.051s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-d3577a8e-5296-4ef9-beeb-346295c65ce0" released by "delete_snapshot" :: held 2.086s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:09 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267" returned: 0 in 0.559s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:09 devstack sudo[107972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e 1G
Nov 03 17:15:09 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:09 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Created reservations ['526aed2c-50a9-4bf9-a795-efe1077a7c8b', '09e0ffe7-664f-41bf-9aab-a85dfc8050ab', 'b8aa6512-2821-47b1-98ca-30e1b34553c3', '655ca603-f56a-4799-a23f-1348c90fd57b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Delete snapshot completed successfully.
Nov 03 17:15:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e40e00f4-0f09-4a07-8a25-7681912721b8 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-dd3f8c1a-cf53-4e26-9123-bd7554bc59d7-delete_snapshot" released by "delete_snapshot" :: held 2.359s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:10 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e 1G" returned: 0 in 0.518s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a72742-5968-43d1-9f39-e54fd7104267 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:10 devstack sudo[107977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a72742-5968-43d1-9f39-e54fd7104267 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e
Nov 03 17:15:10 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:10 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a72742-5968-43d1-9f39-e54fd7104267 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e" returned: 0 in 0.361s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:10 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e is being set with open permissions: ugo+rw
Nov 03 17:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:10 devstack sudo[107988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e
Nov 03 17:15:10 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-d3577a8e-5296-4ef9-beeb-346295c65ce0-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:10 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Lock "cinder-d3577a8e-5296-4ef9-beeb-346295c65ce0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e" returned: 0 in 0.302s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:10 devstack sudo[107991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.info
Nov 03 17:15:10 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-d3577a8e-5296-4ef9-beeb-346295c65ce0" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-d3577a8e-5296-4ef9-beeb-346295c65ce0" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:10 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9e83ea-9e63-44bb-815e-c7da3b601335]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:11 devstack sudo[107994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0
Nov 03 17:15:11 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:11 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.info" returned: 0 in 0.363s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:11 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.info is being set with open permissions: ugo+rw
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:11 devstack sudo[107997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.info
Nov 03 17:15:11 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:11 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0" returned: 0 in 0.479s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:11 devstack sudo[108002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0
Nov 03 17:15:11 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:11 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.info" returned: 0 in 0.398s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.617s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1d6b00bc-9130-4735-91c0-c63e50fd7193 tempest-ProjectReaderTests-1319724341 None] Create snapshot completed successfully
Nov 03 17:15:11 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-d3577a8e-5296-4ef9-beeb-346295c65ce0" returned: 0 in 0.323s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-d3577a8e-5296-4ef9-beeb-346295c65ce0" released by "delete_volume" :: held 0.894s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Created reservations ['8bd1243d-5978-4b2d-8f34-6e886ce5f281', '38a1431e-1ad3-43fa-ab67-5d500b9df86b', 'dfaef9fe-eb30-47cb-b704-65fc5022ed30', '489f6d75-d31e-4949-bfc8-7538d7eb2b1e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:12 devstack sudo[108006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:12 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-3c939e86-42c5-4443-ba53-e191c2f0792e-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:12 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.327s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Deleted volume successfully.
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-3c939e86-42c5-4443-ba53-e191c2f0792e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-82a72742-5968-43d1-9f39-e54fd7104267" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-82a72742-5968-43d1-9f39-e54fd7104267" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-3c939e86-42c5-4443-ba53-e191c2f0792e" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-414627d6-6bb5-4314-a00b-4034ee2364ff tempest-ProjectMemberTests-1397646752 None] Lock "cinder-d3577a8e-5296-4ef9-beeb-346295c65ce0-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-3c939e86-42c5-4443-ba53-e191c2f0792e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Deleting offline snapshot 3c939e86-42c5-4443-ba53-e191c2f0792e of volume 82a72742-5968-43d1-9f39-e54fd7104267 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] snapshot_file for this snap is: volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef29979-fddf-4ae5-a087-b183fc782b9b]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:12 devstack sudo[108009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e
Nov 03 17:15:12 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (f2fc08ee-3fe3-4958-a36e-2b9daaa2d859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defe2508-c310-46dc-97f2-dbc7a3376372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defe2508-c310-46dc-97f2-dbc7a3376372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447142274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:13Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ceb649-24bd-4583-9841-78e0482e16b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ceb649-24bd-4583-9841-78e0482e16b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382dadfe-8177-420f-8c28-c97224af6191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382dadfe-8177-420f-8c28-c97224af6191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3', 'volume_name': 'volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4956c6f6-b8a8-4ffd-b4ba-f74948e59e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4956c6f6-b8a8-4ffd-b4ba-f74948e59e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdd0da0-41c3-475c-8c91-3c19f2b54ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:12 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Volume 96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3', 'volume_size': 1}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447142274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:13Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Creating volume 96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:12 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:12 devstack sudo[108014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 1073741824
Nov 03 17:15:12 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:12 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e" returned: 0 in 0.514s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a72742-5968-43d1-9f39-e54fd7104267(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[abed32a0-d979-4d47-9c1b-f48e5c20e03d]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:13 devstack sudo[108016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267
Nov 03 17:15:13 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:13 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267" returned: 0 in 0.525s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:13 devstack sudo[108025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e
Nov 03 17:15:13 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:13 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 1073741824" returned: 0 in 0.662s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Flow 'volume_create_manager' (9902fdb1-ac61-4f0d-a335-dc0dc7b0f71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342aa642-fd8a-4420-94bd-7cefe83b1164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:13 devstack sudo[108027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342aa642-fd8a-4420-94bd-7cefe83b1164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d37b55-8e21-4757-9e36-b7190566834e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02632e94ad7e49c3be7061a6eecd3d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:14Z,use_quota=True,user_id='f9fd913befad47cba779360aef4a7a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:13 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27286ac9-9660-499e-94cb-96db5ade4de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27286ac9-9660-499e-94cb-96db5ade4de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7aaaf8-bd55-4fc6-89cc-dfe1e017febe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7aaaf8-bd55-4fc6-89cc-dfe1e017febe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d37b55-8e21-4757-9e36-b7190566834e', 'volume_name': 'volume-64d37b55-8e21-4757-9e36-b7190566834e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b014817-f00d-4fc4-aff8-f7b2f82a53e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b014817-f00d-4fc4-aff8-f7b2f82a53e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f33c4ed-7306-499e-a35f-7589441cb208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:13 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Volume 64d37b55-8e21-4757-9e36-b7190566834e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d37b55-8e21-4757-9e36-b7190566834e', 'volume_size': 1}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:13 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e" returned: 0 in 0.434s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:14 devstack sudo[108034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e
Nov 03 17:15:14 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:14 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3" returned: 0 in 0.351s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.262s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d37b55-8e21-4757-9e36-b7190566834e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02632e94ad7e49c3be7061a6eecd3d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:14Z,use_quota=True,user_id='f9fd913befad47cba779360aef4a7a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Creating volume 64d37b55-8e21-4757-9e36-b7190566834e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:14 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-64d37b55-8e21-4757-9e36-b7190566834e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdd0da0-41c3-475c-8c91-3c19f2b54ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a172432-3d03-485e-a1c0-6fcd968dd1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:14 devstack sudo[108036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-64d37b55-8e21-4757-9e36-b7190566834e 1073741824
Nov 03 17:15:14 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:14 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Volume volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 (96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3): created successfully
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a172432-3d03-485e-a1c0-6fcd968dd1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (f2fc08ee-3fe3-4958-a36e-2b9daaa2d859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d3da21eb-13e0-44ea-afab-77f949ba780b tempest-ProjectMemberTests-1397646752 None] Created volume successfully.
Nov 03 17:15:14 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267.3c939e86-42c5-4443-ba53-e191c2f0792e" returned: 0 in 0.308s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-3c939e86-42c5-4443-ba53-e191c2f0792e" released by "_delete_snapshot" :: held 1.930s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-82a72742-5968-43d1-9f39-e54fd7104267" released by "delete_snapshot" :: held 1.975s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Created reservations ['642a448d-d47f-43ce-bff6-bc4468e5426b', 'c42d6d07-51b8-465e-a8d4-6ea26beb613d', 'f99fd746-7aae-492f-a43e-c46a6491aa32', '81169a86-fe5b-48b2-b4e8-57b513a809c7'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Delete snapshot completed successfully.
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d79ce9a6-d19a-416b-8b83-e614d1473344 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-3c939e86-42c5-4443-ba53-e191c2f0792e-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:14 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-64d37b55-8e21-4757-9e36-b7190566834e 1073741824" returned: 0 in 0.600s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-64d37b55-8e21-4757-9e36-b7190566834e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:14 devstack sudo[108043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-64d37b55-8e21-4757-9e36-b7190566834e
Nov 03 17:15:14 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-82a72742-5968-43d1-9f39-e54fd7104267-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-82a72742-5968-43d1-9f39-e54fd7104267-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-82a72742-5968-43d1-9f39-e54fd7104267" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-82a72742-5968-43d1-9f39-e54fd7104267" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdba304d-3148-4e87-9c00-d3ac78f2aa69]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:15 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-64d37b55-8e21-4757-9e36-b7190566834e" returned: 0 in 0.340s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f33c4ed-7306-499e-a35f-7589441cb208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d37b55-8e21-4757-9e36-b7190566834e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f82a63-43eb-4bc8-810f-891934803355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:15 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Volume volume-64d37b55-8e21-4757-9e36-b7190566834e (64d37b55-8e21-4757-9e36-b7190566834e): created successfully
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f82a63-43eb-4bc8-810f-891934803355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Flow 'volume_create_manager' (9902fdb1-ac61-4f0d-a335-dc0dc7b0f71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-106701b8-508e-4179-b16f-6942a6cf42aa tempest-ProjectReaderTests-100919944 None] Created volume successfully.
Nov 03 17:15:15 devstack sudo[108045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267
Nov 03 17:15:15 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] Creating offline snapshot 52c5c26b-826d-4237-8f87-5e4bf1bc6158 of volume 96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[980519a9-a780-4a30-94cb-89e6b2493174]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:15 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267" returned: 0 in 0.556s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:15 devstack sudo[108048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3
Nov 03 17:15:15 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:15 devstack sudo[108052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267
Nov 03 17:15:15 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:15 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-82a72742-5968-43d1-9f39-e54fd7104267" returned: 0 in 0.313s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-82a72742-5968-43d1-9f39-e54fd7104267" released by "delete_volume" :: held 0.984s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:15 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3" returned: 0 in 0.479s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:15 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158 1G
Nov 03 17:15:15 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Created reservations ['ae367529-f8e9-4f0b-8dad-b21eb505b595', '2baf01c0-69ce-4afa-b7e2-d0027b370830', '14740930-f187-47e3-a758-1d9f8c1fd0f7', 'e6df1272-a427-4597-ab2d-068faa8e8272'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Acquiring lock "cinder-64d37b55-8e21-4757-9e36-b7190566834e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Lock "cinder-64d37b55-8e21-4757-9e36-b7190566834e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Acquiring lock "cinder-quobyte-64d37b55-8e21-4757-9e36-b7190566834e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:16 devstack sudo[108061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:16 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Lock "cinder-quobyte-64d37b55-8e21-4757-9e36-b7190566834e" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e993aa8d-6952-49f5-b826-35d83673717d]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-64d37b55-8e21-4757-9e36-b7190566834e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:16 devstack sudo[108065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-64d37b55-8e21-4757-9e36-b7190566834e
Nov 03 17:15:16 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:16 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158 1G" returned: 0 in 0.523s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:16 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.320s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Deleted volume successfully.
Nov 03 17:15:16 devstack sudo[108071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158
Nov 03 17:15:16 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a186c265-fc74-4339-ac48-8fd64d43fc04 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-82a72742-5968-43d1-9f39-e54fd7104267-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:16 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-64d37b55-8e21-4757-9e36-b7190566834e" returned: 0 in 0.464s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-64d37b55-8e21-4757-9e36-b7190566834e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:16 devstack sudo[108076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-64d37b55-8e21-4757-9e36-b7190566834e
Nov 03 17:15:16 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:16 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158" returned: 0 in 0.363s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:16 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158 is being set with open permissions: ugo+rw
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:16 devstack sudo[108081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158
Nov 03 17:15:16 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:16 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-64d37b55-8e21-4757-9e36-b7190566834e" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Lock "cinder-quobyte-64d37b55-8e21-4757-9e36-b7190566834e" released by "delete_volume" :: held 0.808s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Created reservations ['db140e8e-1051-457f-afb8-862b96898054', '5b6a306c-8004-48eb-a3eb-762ae85d9be9', 'bad326fe-ff7c-49ca-90f0-01aa85bceb8d', '7e2cd703-892a-4557-ad14-1ba181c853d1'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:17 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:17 devstack sudo[108085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.info
Nov 03 17:15:17 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:17 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:17 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:17 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.info" returned: 0 in 0.362s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:17 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.info is being set with open permissions: ugo+rw
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:17 devstack sudo[108090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.info
Nov 03 17:15:17 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:17 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.467s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Deleted volume successfully.
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7e72ed95-10f8-48c0-9b25-f4bafb8019d0 tempest-ProjectReaderTests-100919944 None] Lock "cinder-64d37b55-8e21-4757-9e36-b7190566834e-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:17 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.info" returned: 0 in 0.312s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7136b678-ab3e-4514-b1a4-30fe7adf266e tempest-ProjectMemberTests-1397646752 None] Create snapshot completed successfully
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Flow 'volume_create_manager' (b2a1bff3-50ae-4609-9f19-4a93cd99d323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc16851-e861-4579-a366-aada3ebdbf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc16851-e861-4579-a366-aada3ebdbf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1021368315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd47ea79-60cd-4390-b23d-10f6189ba3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06607f442aa646a0abcd4d2dac643351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:18Z,use_quota=True,user_id='88c0ab29b0aa4829ac407cc213f5a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8067125-1d3e-419e-8057-4b4697fb196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8067125-1d3e-419e-8057-4b4697fb196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542981c5-6199-4be9-abe5-1fc94ccee68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542981c5-6199-4be9-abe5-1fc94ccee68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd47ea79-60cd-4390-b23d-10f6189ba3ed', 'volume_name': 'volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb9dbe4-6848-4f57-9ef1-61c153d5bee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb9dbe4-6848-4f57-9ef1-61c153d5bee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ca7e71-fafe-4e67-88dc-8259db4a5a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Volume dd47ea79-60cd-4390-b23d-10f6189ba3ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed', 'volume_size': 1}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1021368315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd47ea79-60cd-4390-b23d-10f6189ba3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06607f442aa646a0abcd4d2dac643351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:18Z,use_quota=True,user_id='88c0ab29b0aa4829ac407cc213f5a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Creating volume dd47ea79-60cd-4390-b23d-10f6189ba3ed {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:17 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:18 devstack sudo[108094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed 1073741824
Nov 03 17:15:18 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Flow 'volume_create_manager' (5f843177-bdc9-40ff-bea8-9700f8f5abff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6358fd1d-77ec-4320-b2f3-59d879f20771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6358fd1d-77ec-4320-b2f3-59d879f20771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096904414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02632e94ad7e49c3be7061a6eecd3d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:18Z,use_quota=True,user_id='f9fd913befad47cba779360aef4a7a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2dc3f2-bee2-4b87-8d56-5e807649f1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2dc3f2-bee2-4b87-8d56-5e807649f1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f75b6b-1d3d-4134-9527-2388bbd01d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f75b6b-1d3d-4134-9527-2388bbd01d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c', 'volume_name': 'volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b84057-e90b-44c7-8858-272f4a6a152c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b84057-e90b-44c7-8858-272f4a6a152c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93541528-0038-4cd4-ace2-70a7ea19e70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:18 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Volume 9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c', 'volume_size': 1}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:18 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed 1073741824" returned: 0 in 0.556s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:18 devstack sudo[108099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed
Nov 03 17:15:18 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:18 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.333s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096904414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02632e94ad7e49c3be7061a6eecd3d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:18Z,use_quota=True,user_id='f9fd913befad47cba779360aef4a7a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Creating volume 9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:18 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-52c5c26b-826d-4237-8f87-5e4bf1bc6158-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:18 devstack sudo[108102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c 1073741824
Nov 03 17:15:18 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ca7e71-fafe-4e67-88dc-8259db4a5a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb921c6-a53e-4d27-9a74-d900c2982297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:18 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Volume volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed (dd47ea79-60cd-4390-b23d-10f6189ba3ed): created successfully
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb921c6-a53e-4d27-9a74-d900c2982297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Flow 'volume_create_manager' (b2a1bff3-50ae-4609-9f19-4a93cd99d323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-52c5c26b-826d-4237-8f87-5e4bf1bc6158-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fce3fe19-7fdc-4005-8d57-f3ab7ba140d3 tempest-ProjectReaderTests-1319724341 None] Created volume successfully.
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-52c5c26b-826d-4237-8f87-5e4bf1bc6158" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-52c5c26b-826d-4237-8f87-5e4bf1bc6158" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Deleting offline snapshot 52c5c26b-826d-4237-8f87-5e4bf1bc6158 of volume 96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] snapshot_file for this snap is: volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[660d06bd-da03-4a91-b09f-cfc5031287d3]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:19 devstack sudo[108104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158
Nov 03 17:15:19 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:19 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c 1073741824" returned: 0 in 0.564s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:19 devstack sudo[108112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c
Nov 03 17:15:19 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:19 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158" returned: 0 in 0.495s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de81c7c-a85f-4799-a791-57a031d3c70c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:19 devstack sudo[108115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3
Nov 03 17:15:19 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:19 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c" returned: 0 in 0.306s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93541528-0038-4cd4-ace2-70a7ea19e70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b714d25-3f54-474d-8b8c-052504dc8c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Volume volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c (9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c): created successfully
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b714d25-3f54-474d-8b8c-052504dc8c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Flow 'volume_create_manager' (5f843177-bdc9-40ff-bea8-9700f8f5abff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8b0ce17b-c1e3-4066-aea1-1e335baaea14 tempest-ProjectReaderTests-100919944 None] Created volume successfully.
Nov 03 17:15:20 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3" returned: 0 in 0.431s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:20 devstack sudo[108121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158
Nov 03 17:15:20 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] Creating offline snapshot a7d7a3af-b076-4b40-8eaa-6720a4088c1d of volume dd47ea79-60cd-4390-b23d-10f6189ba3ed {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[24714063-ae29-4eff-9418-60354750f9b7]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:20 devstack sudo[108159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed
Nov 03 17:15:20 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Acquiring lock "cinder-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:20 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158" returned: 0 in 0.572s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Lock "cinder-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:20 devstack sudo[108162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158
Nov 03 17:15:20 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Acquiring lock "cinder-quobyte-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Lock "cinder-quobyte-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6596dbc-c440-4929-b22f-d428227f8c4a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:20 devstack sudo[108164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c
Nov 03 17:15:20 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:21 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed" returned: 0 in 0.658s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:21 devstack sudo[108173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d 1G
Nov 03 17:15:21 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:21 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3.52c5c26b-826d-4237-8f87-5e4bf1bc6158" returned: 0 in 0.485s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-52c5c26b-826d-4237-8f87-5e4bf1bc6158" released by "_delete_snapshot" :: held 2.136s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3" released by "delete_snapshot" :: held 2.183s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Created reservations ['0185c277-b9f2-4e03-a3ed-dbb92b80ed11', '20b46983-5c95-4b44-ae5a-4407f5ed97bb', '269fc4b0-997e-48b3-91f4-43a00304e9d4', '7b429f35-e3e6-4335-86f4-bc3548319447'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Delete snapshot completed successfully.
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-547d110e-ca34-4a58-b5b9-f1c57c318a16 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-52c5c26b-826d-4237-8f87-5e4bf1bc6158-delete_snapshot" released by "delete_snapshot" :: held 2.504s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:21 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c" returned: 0 in 0.719s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:21 devstack sudo[108183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c
Nov 03 17:15:21 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:21 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d 1G" returned: 0 in 0.575s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:21 devstack sudo[108186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d
Nov 03 17:15:21 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:21 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c" returned: 0 in 0.315s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Lock "cinder-quobyte-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c" released by "delete_volume" :: held 1.089s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Created reservations ['073b29fb-35bf-40e9-ae08-05b0e65d6584', 'cf168885-3163-4d2a-bf09-c0df49900d60', 'ca6c3385-4ed6-4f40-af5e-698133b4b341', 'f4ef62d3-9abd-4dc9-b7c6-6b8e7666712e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:21 devstack sudo[108192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:21 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:22 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d" returned: 0 in 0.420s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:22 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d is being set with open permissions: ugo+rw
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:22 devstack sudo[108194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d
Nov 03 17:15:22 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:22 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.354s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Deleted volume successfully.
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3" acquired by "delete_volume" :: waited 0.058s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:22 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d" returned: 0 in 0.382s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4051005-6e73-4a67-ac81-b741f6dd16ff]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-da5ed81c-70df-44aa-a938-a398bfe1055e tempest-ProjectReaderTests-100919944 None] Lock "cinder-9e447a57-b68e-4651-8c1f-1c4cd6bc1d7c-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:22 devstack sudo[108199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.info
Nov 03 17:15:22 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:22 devstack sudo[108198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3
Nov 03 17:15:22 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:22 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.info" returned: 0 in 0.276s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:22 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.info is being set with open permissions: ugo+rw
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:22 devstack sudo[108203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.info
Nov 03 17:15:22 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:22 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3" returned: 0 in 0.466s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:22 devstack sudo[108208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3
Nov 03 17:15:22 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:23 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.info" returned: 0 in 0.315s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.806s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-19004d41-28a0-4933-b85e-12128d9ca23d tempest-ProjectReaderTests-1319724341 None] Create snapshot completed successfully
Nov 03 17:15:23 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3" returned: 0 in 0.355s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3" released by "delete_volume" :: held 0.926s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Created reservations ['ebe63d40-8bf2-4c17-8a52-5a094b8328e7', 'c44b2585-90bc-4923-87ea-80df5ef2d11c', '361a5748-006c-4fa1-80d6-be400eac19fc', '119ee83e-2e41-4866-80e6-b1a30d042038'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:23 devstack sudo[108212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:23 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-a7d7a3af-b076-4b40-8eaa-6720a4088c1d-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Lock "cinder-a7d7a3af-b076-4b40-8eaa-6720a4088c1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-dd47ea79-60cd-4390-b23d-10f6189ba3ed" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-dd47ea79-60cd-4390-b23d-10f6189ba3ed" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-a7d7a3af-b076-4b40-8eaa-6720a4088c1d" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-a7d7a3af-b076-4b40-8eaa-6720a4088c1d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Deleting offline snapshot a7d7a3af-b076-4b40-8eaa-6720a4088c1d of volume dd47ea79-60cd-4390-b23d-10f6189ba3ed {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] snapshot_file for this snap is: volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[773eb320-e757-4df5-8149-55486acff169]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Flow 'volume_create_manager' (d1e0a4b6-19d3-40e4-9e75-17bafb242afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2b9738-99fa-42c1-a5e3-8ad8aaf6224a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2b9738-99fa-42c1-a5e3-8ad8aaf6224a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1463932464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc03b6a-5c22-40ca-bd83-00a584c6c4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02632e94ad7e49c3be7061a6eecd3d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:24Z,use_quota=True,user_id='f9fd913befad47cba779360aef4a7a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58bef49-0c0d-427b-a10e-0c7fa370c707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:23 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58bef49-0c0d-427b-a10e-0c7fa370c707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4e41dc-4de2-4833-801b-c51de3fa1176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4e41dc-4de2-4833-801b-c51de3fa1176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebc03b6a-5c22-40ca-bd83-00a584c6c4ce', 'volume_name': 'volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03fbbfbf-bc9b-4f08-af91-d850d60f2dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:23 devstack sudo[108214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d
Nov 03 17:15:23 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03fbbfbf-bc9b-4f08-af91-d850d60f2dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafa4262-4452-4697-89be-3b9f37f39f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Volume ebc03b6a-5c22-40ca-bd83-00a584c6c4ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce', 'volume_size': 1}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1463932464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc03b6a-5c22-40ca-bd83-00a584c6c4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02632e94ad7e49c3be7061a6eecd3d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:24Z,use_quota=True,user_id='f9fd913befad47cba779360aef4a7a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Creating volume ebc03b6a-5c22-40ca-bd83-00a584c6c4ce {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:23 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.386s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Deleted volume successfully.
Nov 03 17:15:23 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce 1073741824
Nov 03 17:15:23 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce2127a4-4735-4268-82af-29902b3535d5 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-96a2f53b-c7ff-4e3b-8c9d-7700d3da52b3-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:24 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d" returned: 0 in 0.525s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8062452-ed10-408a-b437-2a3f0f4ca22c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:24 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce 1073741824" returned: 0 in 0.572s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:24 devstack sudo[108225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed
Nov 03 17:15:24 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:24 devstack sudo[108228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce
Nov 03 17:15:24 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:24 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed" returned: 0 in 0.535s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:24 devstack sudo[108234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d
Nov 03 17:15:24 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:24 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce" returned: 0 in 0.374s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafa4262-4452-4697-89be-3b9f37f39f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0501dde-9293-446f-a16b-3f50f0e39c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:24 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Volume volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce (ebc03b6a-5c22-40ca-bd83-00a584c6c4ce): created successfully
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0501dde-9293-446f-a16b-3f50f0e39c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Flow 'volume_create_manager' (d1e0a4b6-19d3-40e4-9e75-17bafb242afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e3802674-e970-4821-8463-f6bdf004c858 tempest-ProjectReaderTests-100919944 None] Created volume successfully.
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (e8513355-1edf-44c2-9e09-3ed65590acc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf99113-5961-41dd-9783-716645a2798f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf99113-5961-41dd-9783-716645a2798f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081835183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc36cbf-4575-4798-bb6d-ab16f617e5f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:25Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8532495d-6364-4d20-84f0-f84981118823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8532495d-6364-4d20-84f0-f84981118823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cc3d94-00f8-44b0-b4f1-496755727e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cc3d94-00f8-44b0-b4f1-496755727e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abc36cbf-4575-4798-bb6d-ab16f617e5f8', 'volume_name': 'volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f9b744-f94e-423b-8019-83bafb43d38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f9b744-f94e-423b-8019-83bafb43d38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b43df83-4d55-4365-a696-a99a953a35bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:25 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Volume abc36cbf-4575-4798-bb6d-ab16f617e5f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8', 'volume_size': 1}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081835183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc36cbf-4575-4798-bb6d-ab16f617e5f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:25Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Creating volume abc36cbf-4575-4798-bb6d-ab16f617e5f8 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:25 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:25 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d" returned: 0 in 0.530s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:25 devstack sudo[108239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8 1073741824
Nov 03 17:15:25 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:25 devstack sudo[108240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d
Nov 03 17:15:25 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:25 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed.a7d7a3af-b076-4b40-8eaa-6720a4088c1d" returned: 0 in 0.299s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-a7d7a3af-b076-4b40-8eaa-6720a4088c1d" released by "_delete_snapshot" :: held 2.045s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-dd47ea79-60cd-4390-b23d-10f6189ba3ed" released by "delete_snapshot" :: held 2.084s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Created reservations ['8197bbcb-c442-4bee-bc5f-07fcfd3cf5a1', 'a33adefb-76de-46a9-9f3d-0b989e35999e', '3c137e87-1da1-4288-af40-1efd383737e9', '24bcc05c-c890-4b0f-b5cb-1655c4bb2559'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Delete snapshot completed successfully.
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a55ed301-a402-444e-b3a0-6b5eb934839b tempest-ProjectReaderTests-1319724341 None] Lock "cinder-a7d7a3af-b076-4b40-8eaa-6720a4088c1d-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:25 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8 1073741824" returned: 0 in 0.664s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Acquiring lock "cinder-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Lock "cinder-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:26 devstack sudo[108248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8
Nov 03 17:15:26 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Acquiring lock "cinder-quobyte-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Lock "cinder-quobyte-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9500480-6788-49e5-9ab2-0e5dc7008c6a]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:26 devstack sudo[108250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce
Nov 03 17:15:26 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:26 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8" returned: 0 in 0.329s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b43df83-4d55-4365-a696-a99a953a35bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0bd6010-d3fa-45ef-b67c-53d0ed253e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Volume volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8 (abc36cbf-4575-4798-bb6d-ab16f617e5f8): created successfully
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0bd6010-d3fa-45ef-b67c-53d0ed253e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (e8513355-1edf-44c2-9e09-3ed65590acc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e2e60bec-dd64-49c1-902a-cfb785dd7201 tempest-ProjectMemberTests-1397646752 None] Created volume successfully.
Nov 03 17:15:26 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce" returned: 0 in 0.477s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:26 devstack sudo[108256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce
Nov 03 17:15:26 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-dd47ea79-60cd-4390-b23d-10f6189ba3ed-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:26 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce" returned: 0 in 0.293s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Lock "cinder-quobyte-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce" released by "delete_volume" :: held 0.830s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-dd47ea79-60cd-4390-b23d-10f6189ba3ed-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "cinder-quobyte-dd47ea79-60cd-4390-b23d-10f6189ba3ed" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-dd47ea79-60cd-4390-b23d-10f6189ba3ed" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Created reservations ['794a6083-af51-48e6-8dbc-5ead00e99932', 'a85700a4-26c8-44b1-9910-9e37c5259d3d', '59973352-8ad1-4968-b6f4-0d5a7e49317f', 'b47aba45-7ff0-4900-bac5-96efd4a2a7ac'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[404e738c-9447-468a-97f3-8b47804d2a49]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:27 devstack sudo[108260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:27 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:27 devstack sudo[108259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed
Nov 03 17:15:27 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:27 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.384s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Deleted volume successfully.
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e3105e16-bedd-4c29-a5dd-34c5096da734 tempest-ProjectReaderTests-100919944 None] Lock "cinder-ebc03b6a-5c22-40ca-bd83-00a584c6c4ce-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] Creating offline snapshot e8c3c14c-c974-414a-a581-d900bcc49024 of volume abc36cbf-4575-4798-bb6d-ab16f617e5f8 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b7996c-3f90-4395-b46e-97c33043fe52]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:27 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed" returned: 0 in 0.777s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:27 devstack sudo[108268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed
Nov 03 17:15:27 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:28 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8
Nov 03 17:15:28 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:28 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Flow 'volume_create_manager' (0543a402-9d1d-4e0e-88a7-3d79a6ab176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ba33af-1c62-4dd8-b1e1-6ba54882bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-dd47ea79-60cd-4390-b23d-10f6189ba3ed" returned: 0 in 0.514s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ba33af-1c62-4dd8-b1e1-6ba54882bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720250886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1290d36b-b166-4322-ba5e-1fb120922678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02632e94ad7e49c3be7061a6eecd3d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:28Z,use_quota=True,user_id='f9fd913befad47cba779360aef4a7a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31e8ee4-d92b-45ce-bcf0-cdb729ab7dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31e8ee4-d92b-45ce-bcf0-cdb729ab7dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5144c695-e449-41c4-a572-f17c55a5826a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5144c695-e449-41c4-a572-f17c55a5826a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1290d36b-b166-4322-ba5e-1fb120922678', 'volume_name': 'volume-1290d36b-b166-4322-ba5e-1fb120922678', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe4de43-1787-4fdb-ae2a-26596619292d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:28 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe4de43-1787-4fdb-ae2a-26596619292d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6056e0-cc91-4ea9-a070-f737eff48da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:28 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Volume 1290d36b-b166-4322-ba5e-1fb120922678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1290d36b-b166-4322-ba5e-1fb120922678', 'volume_size': 1}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-quobyte-dd47ea79-60cd-4390-b23d-10f6189ba3ed" released by "delete_volume" :: held 1.446s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8" returned: 0 in 0.655s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:28 devstack sudo[108275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024 1G
Nov 03 17:15:28 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Created reservations ['35ba5618-8f01-4806-bc7e-22edffc5130a', '9ef4c447-2310-4695-8033-2b11c4767643', '067f3a6e-9de8-4bd9-adb4-6e44dc96c6ca', '27ccc3ab-9223-41ef-b4fd-7874a1e8cdc9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:28 devstack sudo[108277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:28 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:29 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:29 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Deleted volume successfully.
Nov 03 17:15:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6541c4f7-384f-4c41-b248-b098f5bcd269 tempest-ProjectReaderTests-1319724341 None] Lock "cinder-dd47ea79-60cd-4390-b23d-10f6189ba3ed-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:29 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024 1G" returned: 0 in 0.625s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:29 devstack sudo[108284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024
Nov 03 17:15:29 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:29 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:29 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024 is being set with open permissions: ugo+rw
Nov 03 17:15:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:29 devstack sudo[108290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024
Nov 03 17:15:29 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:29 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:29 devstack sudo[108293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.info
Nov 03 17:15:29 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:30 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.info" returned: 0 in 0.310s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:30 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.info is being set with open permissions: ugo+rw
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:30 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.info
Nov 03 17:15:30 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:30 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.info" returned: 0 in 0.327s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.740s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.070s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720250886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1290d36b-b166-4322-ba5e-1fb120922678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02632e94ad7e49c3be7061a6eecd3d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:28Z,use_quota=True,user_id='f9fd913befad47cba779360aef4a7a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Creating volume 1290d36b-b166-4322-ba5e-1fb120922678 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:30 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1290d36b-b166-4322-ba5e-1fb120922678 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:30 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6c605e57-96ad-4d29-959f-3b08a5267be1 tempest-ProjectMemberTests-1397646752 None] Create snapshot completed successfully
Nov 03 17:15:30 devstack sudo[108299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1290d36b-b166-4322-ba5e-1fb120922678 1073741824
Nov 03 17:15:30 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-e8c3c14c-c974-414a-a581-d900bcc49024-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Lock "cinder-e8c3c14c-c974-414a-a581-d900bcc49024-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-abc36cbf-4575-4798-bb6d-ab16f617e5f8" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-abc36cbf-4575-4798-bb6d-ab16f617e5f8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-e8c3c14c-c974-414a-a581-d900bcc49024" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-e8c3c14c-c974-414a-a581-d900bcc49024" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Deleting offline snapshot e8c3c14c-c974-414a-a581-d900bcc49024 of volume abc36cbf-4575-4798-bb6d-ab16f617e5f8 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] snapshot_file for this snap is: volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e2e901-af9b-4092-8941-8a0fa5ad28d3]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:31 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1290d36b-b166-4322-ba5e-1fb120922678 1073741824" returned: 0 in 0.640s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1290d36b-b166-4322-ba5e-1fb120922678 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:31 devstack sudo[108305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024
Nov 03 17:15:31 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:31 devstack sudo[108308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1290d36b-b166-4322-ba5e-1fb120922678
Nov 03 17:15:31 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:31 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1290d36b-b166-4322-ba5e-1fb120922678" returned: 0 in 0.322s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:31 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024" returned: 0 in 0.486s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6056e0-cc91-4ea9-a070-f737eff48da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1290d36b-b166-4322-ba5e-1fb120922678', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cae60c5-2e53-44d0-8a4d-63bf4b7c165b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[029dd14c-dc21-49a1-8e01-48d70fa81089]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Volume volume-1290d36b-b166-4322-ba5e-1fb120922678 (1290d36b-b166-4322-ba5e-1fb120922678): created successfully
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cae60c5-2e53-44d0-8a4d-63bf4b7c165b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Flow 'volume_create_manager' (0543a402-9d1d-4e0e-88a7-3d79a6ab176e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-05074f5a-5120-4d64-8b0a-2a587b874864 tempest-ProjectReaderTests-100919944 None] Created volume successfully.
Nov 03 17:15:31 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8
Nov 03 17:15:31 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:32 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8" returned: 0 in 0.439s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:32 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024
Nov 03 17:15:32 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:32 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024" returned: 0 in 0.397s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:32 devstack sudo[108325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024
Nov 03 17:15:32 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Acquiring lock "cinder-1290d36b-b166-4322-ba5e-1fb120922678-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:32 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Lock "cinder-1290d36b-b166-4322-ba5e-1fb120922678-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8.e8c3c14c-c974-414a-a581-d900bcc49024" returned: 0 in 0.309s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-e8c3c14c-c974-414a-a581-d900bcc49024" released by "_delete_snapshot" :: held 1.780s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-abc36cbf-4575-4798-bb6d-ab16f617e5f8" released by "delete_snapshot" :: held 1.812s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Acquiring lock "cinder-quobyte-1290d36b-b166-4322-ba5e-1fb120922678" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Lock "cinder-quobyte-1290d36b-b166-4322-ba5e-1fb120922678" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f69f5cf-0448-4788-84d6-46c0b19d8424]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1290d36b-b166-4322-ba5e-1fb120922678 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:32 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Created reservations ['3c0f165d-422e-4ffd-9e30-46867ce62476', '4e06cc2e-7e09-4cfa-934c-816adc3fec78', '628e2113-3279-4735-bb63-70a1922af7a0', '26240f5b-9b30-43fc-98c7-0f99145c30f9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Delete snapshot completed successfully.
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bd5c0879-e826-495d-b7ca-cc2b0f71b3ea tempest-ProjectMemberTests-1397646752 None] Lock "cinder-e8c3c14c-c974-414a-a581-d900bcc49024-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:33 devstack sudo[108328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1290d36b-b166-4322-ba5e-1fb120922678
Nov 03 17:15:33 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-abc36cbf-4575-4798-bb6d-ab16f617e5f8-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-abc36cbf-4575-4798-bb6d-ab16f617e5f8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-abc36cbf-4575-4798-bb6d-ab16f617e5f8" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-abc36cbf-4575-4798-bb6d-ab16f617e5f8" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c051ed11-aaf8-4bc3-aaf2-bd3a5f548768]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:33 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1290d36b-b166-4322-ba5e-1fb120922678" returned: 0 in 0.569s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1290d36b-b166-4322-ba5e-1fb120922678 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:33 devstack sudo[108334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1290d36b-b166-4322-ba5e-1fb120922678
Nov 03 17:15:33 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:33 devstack sudo[108332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8
Nov 03 17:15:33 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:33 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-1290d36b-b166-4322-ba5e-1fb120922678" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Lock "cinder-quobyte-1290d36b-b166-4322-ba5e-1fb120922678" released by "delete_volume" :: held 0.900s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:33 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Created reservations ['2fd3bd8b-7169-4204-a384-882742266be4', '9d3cfed4-52d4-47ae-b475-b67a85068a49', 'a70f9afa-3193-4dba-a42f-a03e9ead03b8', '4051b74e-e4e2-45e2-83a1-9bd11e8bc675'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8" returned: 0 in 0.472s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:33 devstack sudo[108342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8
Nov 03 17:15:33 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:34 devstack sudo[108344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:34 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:34 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-abc36cbf-4575-4798-bb6d-ab16f617e5f8" returned: 0 in 0.337s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-abc36cbf-4575-4798-bb6d-ab16f617e5f8" released by "delete_volume" :: held 0.920s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:34 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Deleted volume successfully.
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ac5cfb32-bfba-4865-8853-aa90f46f33d0 tempest-ProjectReaderTests-100919944 None] Lock "cinder-1290d36b-b166-4322-ba5e-1fb120922678-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Created reservations ['7ad787b7-6300-400c-87a6-d5922b2fb7d5', '8ae491e9-0041-4c61-a81e-5b3e94ea7453', 'f3d285cc-f479-4eed-9eda-f3093cbbce48', '81fba7d1-abfd-4ad6-9511-d2f532fb5823'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Flow 'volume_create_manager' (06c0f320-091a-4508-a4d3-a3ff24259f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0bd727-04fe-403e-b921-6b7da743275b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0bd727-04fe-403e-b921-6b7da743275b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823030864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b339b6ee0f3145ebb6089701a20cefa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:34Z,use_quota=True,user_id='bd5815ab52864a46a909ccb5fe4cc56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc37d677-3075-4b06-bee1-9ac565bfbdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc37d677-3075-4b06-bee1-9ac565bfbdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2791eaff-7f26-4cd1-833c-a90648c115ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2791eaff-7f26-4cd1-833c-a90648c115ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36', 'volume_name': 'volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfeaabd-73bc-4c40-9247-b169bd39b56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfeaabd-73bc-4c40-9247-b169bd39b56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fea55a-53f4-48ed-b05a-4e1c7784c414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:34 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Volume b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36', 'volume_size': 1}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823030864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b339b6ee0f3145ebb6089701a20cefa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:34Z,use_quota=True,user_id='bd5815ab52864a46a909ccb5fe4cc56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Creating volume b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:34 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:34 devstack sudo[108348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36 1073741824
Nov 03 17:15:34 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:34 devstack sudo[108350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:34 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:34 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.289s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Deleted volume successfully.
Nov 03 17:15:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0dac0ddc-6730-45e5-b9a1-c0218766a930 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-abc36cbf-4575-4798-bb6d-ab16f617e5f8-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:35 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36 1073741824" returned: 0 in 0.559s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (9164045b-3296-4686-a437-1d3dd27c3d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab53dd0a-7c92-469f-a85c-eeb188514ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab53dd0a-7c92-469f-a85c-eeb188514ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1054580627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9bb669-8862-4785-bd5a-1aa0dad1fbde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:35Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3530fd89-1b6b-4f8f-b4b0-3d1774b29741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3530fd89-1b6b-4f8f-b4b0-3d1774b29741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18021365-63e9-43b3-889f-fbbd692b828c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18021365-63e9-43b3-889f-fbbd692b828c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff9bb669-8862-4785-bd5a-1aa0dad1fbde', 'volume_name': 'volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd5336c-1854-46b3-b059-09f737e160de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd5336c-1854-46b3-b059-09f737e160de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611db7b7-5208-4e4b-b064-26bd5cff6b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:35 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Volume ff9bb669-8862-4785-bd5a-1aa0dad1fbde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde', 'volume_size': 1}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:35 devstack sudo[108356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36
Nov 03 17:15:35 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:35 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36" returned: 0 in 0.279s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.300s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1054580627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9bb669-8862-4785-bd5a-1aa0dad1fbde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:35Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Creating volume ff9bb669-8862-4785-bd5a-1aa0dad1fbde {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:35 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fea55a-53f4-48ed-b05a-4e1c7784c414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:35 devstack sudo[108359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde 1073741824
Nov 03 17:15:35 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e89fb05-4b22-47b8-b619-2332bbcedf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:35 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Volume volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36 (b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36): created successfully
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e89fb05-4b22-47b8-b619-2332bbcedf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Flow 'volume_create_manager' (06c0f320-091a-4508-a4d3-a3ff24259f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2009e450-ffa8-4d65-a2f7-1eaf97d88fb9 tempest-ProjectReaderTests-1104257617 None] Created volume successfully.
Nov 03 17:15:35 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde 1073741824" returned: 0 in 0.498s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:36 devstack sudo[108365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde
Nov 03 17:15:36 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:36 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde" returned: 0 in 0.380s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611db7b7-5208-4e4b-b064-26bd5cff6b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22fa1bf-92c3-4726-b947-8b6309412628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:36 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Volume volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde (ff9bb669-8862-4785-bd5a-1aa0dad1fbde): created successfully
Nov 03 17:15:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22fa1bf-92c3-4726-b947-8b6309412628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (9164045b-3296-4686-a437-1d3dd27c3d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-85889a36-8ea0-47f4-a336-fc55a879dea6 tempest-ProjectMemberTests-1397646752 None] Created volume successfully.
Nov 03 17:15:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Acquiring lock "cinder-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Lock "cinder-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Acquiring lock "cinder-quobyte-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Lock "cinder-quobyte-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:36 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55f57be-eb9c-465a-ae83-11df38ecd4ff]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:37 devstack sudo[108369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36
Nov 03 17:15:37 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] Creating offline snapshot 287003a5-8d11-46dc-9f3d-550f4cfca5f9 of volume ff9bb669-8862-4785-bd5a-1aa0dad1fbde {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:15:37 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c8e5fa-6c4d-4b63-975b-66bf32343ab2]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:37 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36" returned: 0 in 0.521s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:37 devstack sudo[108375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36
Nov 03 17:15:37 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:37 devstack sudo[108374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde
Nov 03 17:15:37 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:37 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36" returned: 0 in 0.277s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Lock "cinder-quobyte-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36" released by "delete_volume" :: held 0.860s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:37 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Created reservations ['9ef416a6-c41c-4704-8427-1c20697bca9a', '98b8c6ba-ecaf-4bf0-bd72-16d5340636cb', 'ac06f0c8-fe6d-4b06-9957-5aadcf0a56cb', 'e9173560-398a-4ccc-b7ba-3dc4a4a96560'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:37 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde" returned: 0 in 0.411s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:37 devstack sudo[108382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9 1G
Nov 03 17:15:37 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:38 devstack sudo[108384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:38 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:38 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.297s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:38 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Deleted volume successfully.
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9 1G" returned: 0 in 0.474s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3ec8f00c-4da5-4766-83ec-ef75aa7226d5 tempest-ProjectReaderTests-1104257617 None] Lock "cinder-b5aef4fb-7ac3-4278-9a00-5d5a9b52ea36-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:38 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9
Nov 03 17:15:38 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Flow 'volume_create_manager' (ccbd51b7-b841-4099-b661-975502eba997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d9a8ce-42b3-4b21-acf1-58d0d4bf121e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d9a8ce-42b3-4b21-acf1-58d0d4bf121e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-462955606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90d26f2-6459-4b6a-9c8b-966462bdfda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b339b6ee0f3145ebb6089701a20cefa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:39Z,use_quota=True,user_id='bd5815ab52864a46a909ccb5fe4cc56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:38 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0e28a1-d64f-4365-891e-f9906b1be662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0e28a1-d64f-4365-891e-f9906b1be662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0434230f-2718-4dd8-9ab0-278525e37b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0434230f-2718-4dd8-9ab0-278525e37b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e90d26f2-6459-4b6a-9c8b-966462bdfda5', 'volume_name': 'volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df24a9cc-75c7-478c-a5ec-5a3f6664b015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df24a9cc-75c7-478c-a5ec-5a3f6664b015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5119768-d20b-408a-8f71-14381fbe44a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:38 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Volume e90d26f2-6459-4b6a-9c8b-966462bdfda5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5', 'volume_size': 1}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9" returned: 0 in 0.381s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:38 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9 is being set with open permissions: ugo+rw
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:38 devstack sudo[108397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9
Nov 03 17:15:38 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:38 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9" returned: 0 in 0.240s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:39 devstack sudo[108400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.info
Nov 03 17:15:39 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:39 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.info" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:39 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.info is being set with open permissions: ugo+rw
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:39 devstack sudo[108403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.info
Nov 03 17:15:39 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:39 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.info" returned: 0 in 0.279s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.823s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-462955606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90d26f2-6459-4b6a-9c8b-966462bdfda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b339b6ee0f3145ebb6089701a20cefa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:39Z,use_quota=True,user_id='bd5815ab52864a46a909ccb5fe4cc56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Creating volume e90d26f2-6459-4b6a-9c8b-966462bdfda5 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:39 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:39 devstack sudo[108406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5 1073741824
Nov 03 17:15:39 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-09e941d3-b041-43da-963e-e54077fc4f47 tempest-ProjectMemberTests-1397646752 None] Create snapshot completed successfully
Nov 03 17:15:39 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5 1073741824" returned: 0 in 0.437s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:40 devstack sudo[108411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5
Nov 03 17:15:40 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:40 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5" returned: 0 in 0.275s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5119768-d20b-408a-8f71-14381fbe44a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740c643d-9993-4552-b944-a8322bdf6c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Volume volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5 (e90d26f2-6459-4b6a-9c8b-966462bdfda5): created successfully
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740c643d-9993-4552-b944-a8322bdf6c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Flow 'volume_create_manager' (ccbd51b7-b841-4099-b661-975502eba997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3f44f554-0133-458b-8c8e-1c465275643e tempest-ProjectReaderTests-1104257617 None] Created volume successfully.
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-287003a5-8d11-46dc-9f3d-550f4cfca5f9-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-287003a5-8d11-46dc-9f3d-550f4cfca5f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-ff9bb669-8862-4785-bd5a-1aa0dad1fbde" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-ff9bb669-8862-4785-bd5a-1aa0dad1fbde" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-287003a5-8d11-46dc-9f3d-550f4cfca5f9" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-287003a5-8d11-46dc-9f3d-550f4cfca5f9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Deleting offline snapshot 287003a5-8d11-46dc-9f3d-550f4cfca5f9 of volume ff9bb669-8862-4785-bd5a-1aa0dad1fbde {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] snapshot_file for this snap is: volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f3ee1d-5b99-46bd-8400-e8e3ef2f1404]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Acquiring lock "cinder-e90d26f2-6459-4b6a-9c8b-966462bdfda5-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Lock "cinder-e90d26f2-6459-4b6a-9c8b-966462bdfda5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:40 devstack sudo[108415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9
Nov 03 17:15:40 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Acquiring lock "cinder-quobyte-e90d26f2-6459-4b6a-9c8b-966462bdfda5" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Lock "cinder-quobyte-e90d26f2-6459-4b6a-9c8b-966462bdfda5" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[13608688-442a-4310-b03e-060ef82c21e5]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:41 devstack sudo[108418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5
Nov 03 17:15:41 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:41 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9" returned: 0 in 0.418s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fea7a5-b125-460f-967d-a9a0f30745c8]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:41 devstack sudo[108423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde
Nov 03 17:15:41 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:41 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5" returned: 0 in 0.442s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:41 devstack sudo[108428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5
Nov 03 17:15:41 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:41 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde" returned: 0 in 0.430s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:41 devstack sudo[108433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9
Nov 03 17:15:41 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:41 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-e90d26f2-6459-4b6a-9c8b-966462bdfda5" returned: 0 in 0.294s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Lock "cinder-quobyte-e90d26f2-6459-4b6a-9c8b-966462bdfda5" released by "delete_volume" :: held 0.798s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Created reservations ['f18f1943-e044-4d84-8dfd-5a137a56586a', '591327ba-bba1-4263-8709-48e77b73aa2d', 'a74a55d9-2534-45e9-b910-6432dd94a86e', '57fa1a00-4d05-48e1-94d0-aa76d05fca01'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:41 devstack sudo[108436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:41 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:42 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9" returned: 0 in 0.416s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:42 devstack sudo[108441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9
Nov 03 17:15:42 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:42 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.292s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Deleted volume successfully.
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-63fd40aa-3429-41e9-96fb-9ddb42499079 tempest-ProjectReaderTests-1104257617 None] Lock "cinder-e90d26f2-6459-4b6a-9c8b-966462bdfda5-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:42 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde.287003a5-8d11-46dc-9f3d-550f4cfca5f9" returned: 0 in 0.302s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-287003a5-8d11-46dc-9f3d-550f4cfca5f9" released by "_delete_snapshot" :: held 1.698s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-ff9bb669-8862-4785-bd5a-1aa0dad1fbde" released by "delete_snapshot" :: held 1.725s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Created reservations ['2a809b20-6eed-4db3-a5af-82cd589fbc1b', '4245e0b0-1c52-419e-a3e6-7e6c57798c60', '90d52b38-2368-455e-91a7-3579adb4b4d4', '2c3e4d46-cce7-4e47-b594-f19f8f877805'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Delete snapshot completed successfully.
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eb417584-3254-4f2f-be70-ff23324cee10 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-287003a5-8d11-46dc-9f3d-550f4cfca5f9-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-ff9bb669-8862-4785-bd5a-1aa0dad1fbde-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Lock "cinder-ff9bb669-8862-4785-bd5a-1aa0dad1fbde-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-ff9bb669-8862-4785-bd5a-1aa0dad1fbde" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-ff9bb669-8862-4785-bd5a-1aa0dad1fbde" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eecba0-d00b-4efb-97bc-d2b7bbac5036]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:43 devstack sudo[108445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde
Nov 03 17:15:43 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:43 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde" returned: 0 in 0.437s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:43 devstack sudo[108452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde
Nov 03 17:15:43 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:43 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-ff9bb669-8862-4785-bd5a-1aa0dad1fbde" returned: 0 in 0.272s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-ff9bb669-8862-4785-bd5a-1aa0dad1fbde" released by "delete_volume" :: held 0.788s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:43 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Created reservations ['7535153e-c88a-4e57-ada5-fc50d8164b2e', 'cb083eca-1ab5-420c-ba63-b5c253cc7fdc', '9816f42b-79e2-4341-b029-6c8168faaa40', '3c57747b-ead3-4f9c-b8dc-06903ba13a55'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:43 devstack sudo[108455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:43 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:44 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.288s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Deleted volume successfully.
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-069c1079-b488-4ac8-8fb9-1ba95360706b tempest-ProjectMemberTests-1397646752 None] Lock "cinder-ff9bb669-8862-4785-bd5a-1aa0dad1fbde-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (6771f70c-4fe6-4ee9-b337-db73dc225e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a158543-68ac-4e8a-a7f3-e5dceca915ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a158543-68ac-4e8a-a7f3-e5dceca915ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597210050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414d3c85-37ab-41b4-a2a8-371cd56f1d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:45Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da70868-ac58-48fa-8339-7dd696360fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da70868-ac58-48fa-8339-7dd696360fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7559b548-0e07-4848-8349-90ba64a6446e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7559b548-0e07-4848-8349-90ba64a6446e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414d3c85-37ab-41b4-a2a8-371cd56f1d63', 'volume_name': 'volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8b953c-db4c-462f-acd2-7c8cdc569d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8b953c-db4c-462f-acd2-7c8cdc569d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba56b4c-e4df-4929-96eb-664d4a65ab30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:44 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Volume 414d3c85-37ab-41b4-a2a8-371cd56f1d63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63', 'volume_size': 1}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597210050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414d3c85-37ab-41b4-a2a8-371cd56f1d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:45Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Creating volume 414d3c85-37ab-41b4-a2a8-371cd56f1d63 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:44 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:44 devstack sudo[108458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63 1073741824
Nov 03 17:15:44 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:45 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63 1073741824" returned: 0 in 0.482s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:45 devstack sudo[108463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63
Nov 03 17:15:45 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:45 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63" returned: 0 in 0.317s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba56b4c-e4df-4929-96eb-664d4a65ab30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878d8247-3abe-42a0-bfdf-7f664f68fd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:45 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Volume volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63 (414d3c85-37ab-41b4-a2a8-371cd56f1d63): created successfully
Nov 03 17:15:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878d8247-3abe-42a0-bfdf-7f664f68fd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (6771f70c-4fe6-4ee9-b337-db73dc225e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9a297477-737d-486d-9e6c-32928c6a7b7f tempest-ProjectMemberTests-1397646752 None] Created volume successfully.
Nov 03 17:15:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] Creating offline snapshot 77e4dfe1-f44c-4434-8679-820650410811 of volume 414d3c85-37ab-41b4-a2a8-371cd56f1d63 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:15:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac6cce7-60e8-4fb5-b8d5-970a6fbcc535]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:46 devstack sudo[108466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63
Nov 03 17:15:46 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:47 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63" returned: 0 in 0.420s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:47 devstack sudo[108472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811 1G
Nov 03 17:15:47 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:47 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811 1G" returned: 0 in 0.471s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:47 devstack sudo[108478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811
Nov 03 17:15:47 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:48 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811" returned: 0 in 0.319s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:48 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811 is being set with open permissions: ugo+rw
Nov 03 17:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:48 devstack sudo[108483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811
Nov 03 17:15:48 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:48 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:48 devstack sudo[108486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.info
Nov 03 17:15:48 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:48 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.info" returned: 0 in 0.296s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:48 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.info is being set with open permissions: ugo+rw
Nov 03 17:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:48 devstack sudo[108489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.info
Nov 03 17:15:48 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:48 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.info" returned: 0 in 0.283s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.163s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b4835df3-f0b4-45db-99d5-1c84c60ebb82 tempest-ProjectMemberTests-1397646752 None] Create snapshot completed successfully
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-77e4dfe1-f44c-4434-8679-820650410811-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Lock "cinder-77e4dfe1-f44c-4434-8679-820650410811-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-414d3c85-37ab-41b4-a2a8-371cd56f1d63" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-414d3c85-37ab-41b4-a2a8-371cd56f1d63" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-77e4dfe1-f44c-4434-8679-820650410811" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-77e4dfe1-f44c-4434-8679-820650410811" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Deleting offline snapshot 77e4dfe1-f44c-4434-8679-820650410811 of volume 414d3c85-37ab-41b4-a2a8-371cd56f1d63 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] snapshot_file for this snap is: volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8468d73e-1e88-4e92-8189-33d5ea86d574]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:50 devstack sudo[108492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811
Nov 03 17:15:50 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:50 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b714a6-644a-4da1-b92f-2ec559c88471]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:50 devstack sudo[108497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63
Nov 03 17:15:50 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:51 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63" returned: 0 in 0.437s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:51 devstack sudo[108504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811
Nov 03 17:15:51 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:51 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811" returned: 0 in 0.471s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:51 devstack sudo[108509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811
Nov 03 17:15:51 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:51 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63.77e4dfe1-f44c-4434-8679-820650410811" returned: 0 in 0.329s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:51 devstack sudo[108512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:51 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-77e4dfe1-f44c-4434-8679-820650410811" released by "_delete_snapshot" :: held 1.814s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-414d3c85-37ab-41b4-a2a8-371cd56f1d63" released by "delete_snapshot" :: held 1.853s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Created reservations ['db4906f2-9d56-4f57-a6d9-0043cb8400bb', '4faa5e11-94c2-4372-ab37-46946f07726f', 'a5ea16a6-6df3-44fd-a0c2-2841c1b1a0d5', '1c511a65-5319-417e-b98f-fd7b5b116629'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:52 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Delete snapshot completed successfully.
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3c035dd2-9f03-4f97-8f9f-5cf534230eab tempest-ProjectMemberTests-1397646752 None] Lock "cinder-77e4dfe1-f44c-4434-8679-820650410811-delete_snapshot" released by "delete_snapshot" :: held 2.081s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:52 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 29 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>, <Thread(Rabbit-heartbeat, started daemon 139029247180864)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-414d3c85-37ab-41b4-a2a8-371cd56f1d63-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-414d3c85-37ab-41b4-a2a8-371cd56f1d63-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-414d3c85-37ab-41b4-a2a8-371cd56f1d63" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-414d3c85-37ab-41b4-a2a8-371cd56f1d63" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2227f1-113b-4213-8b04-71ab2811d3e0]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:52 devstack sudo[108515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63
Nov 03 17:15:52 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:52 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63" returned: 0 in 0.405s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:52 devstack sudo[108520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63
Nov 03 17:15:52 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:53 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-414d3c85-37ab-41b4-a2a8-371cd56f1d63" returned: 0 in 0.257s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-414d3c85-37ab-41b4-a2a8-371cd56f1d63" released by "delete_volume" :: held 0.737s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:INSERT=74,cinder:UPDATE=270,cinder:SELECT=204,cinder:DELETE=19 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=194,cinder:INSERT=69,cinder:UPDATE=270,cinder:DELETE=24 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Created reservations ['687d8ad8-ab77-4658-a274-85aeadc98d26', '34c7e124-ea34-4369-a210-fc1cf03c0e17', 'd5d499d8-846a-4150-8d41-2e7eb777c6e1', 'a50968d0-fec0-4279-afee-f0387ffc94cc'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:53 devstack sudo[108523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:15:53 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:53 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:15:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Deleted volume successfully.
Nov 03 17:15:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-76ddbf63-76de-4596-939d-d9b27c7b9ba5 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-414d3c85-37ab-41b4-a2a8-371cd56f1d63-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (6385f215-b48e-41f8-ae75-a2ab7535d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d5aee0-c6e4-400d-acf6-10f26c016fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d5aee0-c6e4-400d-acf6-10f26c016fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-227770639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ac7973-b95b-4022-8ce2-662b36391cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:54Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd0e6f7-d92a-4e10-b3fc-8230ad31cc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd0e6f7-d92a-4e10-b3fc-8230ad31cc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69484d4-6e82-469a-af23-850a13a7fbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69484d4-6e82-469a-af23-850a13a7fbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06ac7973-b95b-4022-8ce2-662b36391cf7', 'volume_name': 'volume-06ac7973-b95b-4022-8ce2-662b36391cf7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fdde2e-9b97-41ec-b038-7129c813a7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fdde2e-9b97-41ec-b038-7129c813a7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9f252d-b1da-4d1f-8c86-d765ec05fd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Volume 06ac7973-b95b-4022-8ce2-662b36391cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06ac7973-b95b-4022-8ce2-662b36391cf7', 'volume_size': 1}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-227770639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ac7973-b95b-4022-8ce2-662b36391cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:54Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Creating volume 06ac7973-b95b-4022-8ce2-662b36391cf7 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:15:54 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:15:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:54 devstack sudo[108526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7 1073741824
Nov 03 17:15:54 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:55 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7 1073741824" returned: 0 in 0.703s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:55 devstack sudo[108532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7
Nov 03 17:15:55 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:55 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7" returned: 0 in 0.292s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:15:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9f252d-b1da-4d1f-8c86-d765ec05fd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06ac7973-b95b-4022-8ce2-662b36391cf7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca9889d-b9a8-4b41-94e3-7918ce42370d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:15:55 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Volume volume-06ac7973-b95b-4022-8ce2-662b36391cf7 (06ac7973-b95b-4022-8ce2-662b36391cf7): created successfully
Nov 03 17:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca9889d-b9a8-4b41-94e3-7918ce42370d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (6385f215-b48e-41f8-ae75-a2ab7535d127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:15:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-53f4039e-571c-460a-865d-7ddf5c70dd7f tempest-ProjectMemberTests-1397646752 None] Created volume successfully.
Nov 03 17:15:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:15:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:15:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] Creating offline snapshot afeeb103-cfd4-4d74-a59a-b08e2a3aa42e of volume 06ac7973-b95b-4022-8ce2-662b36391cf7 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:15:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd47af15-7b26-4d98-9eaa-ddeb707b31a6]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:56 devstack sudo[108535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7
Nov 03 17:15:56 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:57 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7" returned: 0 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:57 devstack sudo[108540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e 1G
Nov 03 17:15:57 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:57 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e 1G" returned: 0 in 0.480s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06ac7973-b95b-4022-8ce2-662b36391cf7 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:57 devstack sudo[108546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06ac7973-b95b-4022-8ce2-662b36391cf7 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e
Nov 03 17:15:57 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:57 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06ac7973-b95b-4022-8ce2-662b36391cf7 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e" returned: 0 in 0.323s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:57 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e is being set with open permissions: ugo+rw
Nov 03 17:15:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:57 devstack sudo[108551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e
Nov 03 17:15:57 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:58 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e" returned: 0 in 0.303s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:58 devstack sudo[108554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.info
Nov 03 17:15:58 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:58 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.info" returned: 0 in 0.288s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:58 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.info is being set with open permissions: ugo+rw
Nov 03 17:15:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:58 devstack sudo[108557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.info
Nov 03 17:15:58 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:15:58 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root
Nov 03 17:15:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.info" returned: 0 in 0.288s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:15:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:15:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ac1f0c9f-5230-4cce-b32d-e8011024cf17 tempest-ProjectMemberTests-1397646752 None] Create snapshot completed successfully
Nov 03 17:15:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-afeeb103-cfd4-4d74-a59a-b08e2a3aa42e-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-afeeb103-cfd4-4d74-a59a-b08e2a3aa42e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-06ac7973-b95b-4022-8ce2-662b36391cf7" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-06ac7973-b95b-4022-8ce2-662b36391cf7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-afeeb103-cfd4-4d74-a59a-b08e2a3aa42e" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:15:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-afeeb103-cfd4-4d74-a59a-b08e2a3aa42e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:15:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Deleting offline snapshot afeeb103-cfd4-4d74-a59a-b08e2a3aa42e of volume 06ac7973-b95b-4022-8ce2-662b36391cf7 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:15:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] snapshot_file for this snap is: volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:15:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04b6330-d5c7-4d4f-8db7-46b3e21c17e6]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:15:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:15:59 devstack sudo[108561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e
Nov 03 17:15:59 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:00 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e" returned: 0 in 0.445s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06ac7973-b95b-4022-8ce2-662b36391cf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:16:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[659b7f2b-2454-485f-8d26-5a215432e677]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:00 devstack sudo[108566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7
Nov 03 17:16:00 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:00 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7" returned: 0 in 0.463s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:00 devstack sudo[108571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e
Nov 03 17:16:00 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:01 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e" returned: 0 in 0.462s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:01 devstack sudo[108578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e
Nov 03 17:16:01 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:01 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7.afeeb103-cfd4-4d74-a59a-b08e2a3aa42e" returned: 0 in 0.290s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-afeeb103-cfd4-4d74-a59a-b08e2a3aa42e" released by "_delete_snapshot" :: held 1.818s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-06ac7973-b95b-4022-8ce2-662b36391cf7" released by "delete_snapshot" :: held 1.847s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:01 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Created reservations ['a444c2b7-29ed-4a8a-8360-1ffc3243a866', '5ff52319-cd8d-4e8c-874c-6b9b28e98b08', '964d5a0f-6cd8-4f3c-b482-de30a61a66b7', 'bf97c19c-e998-4608-babc-d90caf0ecf25'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:16:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Delete snapshot completed successfully.
Nov 03 17:16:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a162bff6-03b7-494d-b46f-a442d6f95485 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-afeeb103-cfd4-4d74-a59a-b08e2a3aa42e-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-06ac7973-b95b-4022-8ce2-662b36391cf7-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-06ac7973-b95b-4022-8ce2-662b36391cf7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-06ac7973-b95b-4022-8ce2-662b36391cf7" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-06ac7973-b95b-4022-8ce2-662b36391cf7" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08ab37d-e1f3-4c0d-bcc6-093abd3a51e2]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:02 devstack sudo[108581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7
Nov 03 17:16:02 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:02 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7" returned: 0 in 0.473s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:02 devstack sudo[108586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7
Nov 03 17:16:02 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:02 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-06ac7973-b95b-4022-8ce2-662b36391cf7" returned: 0 in 0.290s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-06ac7973-b95b-4022-8ce2-662b36391cf7" released by "delete_volume" :: held 0.855s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Created reservations ['e56c5d09-e91a-4fd1-bf1a-024f756a9e17', 'a38c0ba9-6f91-4658-ab68-a667df2503bc', 'd7ea2673-8b0c-4551-b31a-b88a46bebc16', '90de8877-0c94-49be-a13b-18aeec70df4b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:03 devstack sudo[108589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:16:03 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:03 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.360s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:16:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Deleted volume successfully.
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-66e9835f-52e2-491d-9bd2-65e690843cd6 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-06ac7973-b95b-4022-8ce2-662b36391cf7-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (6effb014-5ea8-43d3-a331-759f263eaedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c460c594-dafe-410b-8772-5eb6a804c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c460c594-dafe-410b-8772-5eb6a804c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-969365515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24680e1-5457-4583-828f-646e26d098e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:04Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630102e9-45b2-46f7-b104-05adce9ec7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630102e9-45b2-46f7-b104-05adce9ec7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8881506b-c478-40c3-9d2f-9850efa2747d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8881506b-c478-40c3-9d2f-9850efa2747d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24680e1-5457-4583-828f-646e26d098e9', 'volume_name': 'volume-b24680e1-5457-4583-828f-646e26d098e9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4b96d3-4f1b-4abb-a06e-e3a63b414b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4b96d3-4f1b-4abb-a06e-e3a63b414b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7d46aa-208b-4b4e-b2eb-d6509dad75cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:03 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Volume b24680e1-5457-4583-828f-646e26d098e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24680e1-5457-4583-828f-646e26d098e9', 'volume_size': 1}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-969365515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24680e1-5457-4583-828f-646e26d098e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:04Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Creating volume b24680e1-5457-4583-828f-646e26d098e9 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:16:03 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:04 devstack sudo[108592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9 1073741824
Nov 03 17:16:04 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:04 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9 1073741824" returned: 0 in 0.542s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:04 devstack sudo[108598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9
Nov 03 17:16:04 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:04 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9" returned: 0 in 0.364s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:16:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7d46aa-208b-4b4e-b2eb-d6509dad75cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24680e1-5457-4583-828f-646e26d098e9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b97acd-302a-4238-b8d3-ed0ec35823c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:04 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Volume volume-b24680e1-5457-4583-828f-646e26d098e9 (b24680e1-5457-4583-828f-646e26d098e9): created successfully
Nov 03 17:16:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b97acd-302a-4238-b8d3-ed0ec35823c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (6effb014-5ea8-43d3-a331-759f263eaedc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:16:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-094e0c4a-4609-4d2d-bfd3-0f4ea3477cd7 tempest-ProjectMemberTests-1397646752 None] Created volume successfully.
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Flow 'volume_create_manager' (625b2ec1-db2b-465a-8649-fac52005fadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7f4688-591b-4b68-b429-2a937d2ccbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7f4688-591b-4b68-b429-2a937d2ccbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-735238299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d713cfa-eed9-4c13-b627-ee2660b8de81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec987be5c99c4ebeafc8c7fea2a3324a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:06Z,use_quota=True,user_id='1a41a799d4a447c18acd702fcb03d8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c912c84d-f1c2-4cd4-9be8-bfd8808c951c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c912c84d-f1c2-4cd4-9be8-bfd8808c951c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061c1a96-45f6-441e-b638-a43971222a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061c1a96-45f6-441e-b638-a43971222a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d713cfa-eed9-4c13-b627-ee2660b8de81', 'volume_name': 'volume-7d713cfa-eed9-4c13-b627-ee2660b8de81', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1f60a0-a649-4b45-a77e-25035615e831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1f60a0-a649-4b45-a77e-25035615e831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e1fc7a-0d6c-4003-8dd4-b93866cb3bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Volume 7d713cfa-eed9-4c13-b627-ee2660b8de81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d713cfa-eed9-4c13-b627-ee2660b8de81', 'volume_size': 1}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-735238299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d713cfa-eed9-4c13-b627-ee2660b8de81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec987be5c99c4ebeafc8c7fea2a3324a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:06Z,use_quota=True,user_id='1a41a799d4a447c18acd702fcb03d8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Creating volume 7d713cfa-eed9-4c13-b627-ee2660b8de81 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:16:06 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:06 devstack sudo[108601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 1073741824
Nov 03 17:16:06 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:06 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 1073741824" returned: 0 in 0.447s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:06 devstack sudo[108606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81
Nov 03 17:16:06 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:07 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81" returned: 0 in 0.275s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.734s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e1fc7a-0d6c-4003-8dd4-b93866cb3bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d713cfa-eed9-4c13-b627-ee2660b8de81', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a136603-4ce5-44c2-b5d8-ab8a725dc2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] Creating offline snapshot 018cd2bc-5d7d-4e69-82cd-d6880b2ac11c of volume b24680e1-5457-4583-828f-646e26d098e9 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[075acf06-b088-4d33-82a9-160297409d07]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:07 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Volume volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 (7d713cfa-eed9-4c13-b627-ee2660b8de81): created successfully
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a136603-4ce5-44c2-b5d8-ab8a725dc2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Flow 'volume_create_manager' (625b2ec1-db2b-465a-8649-fac52005fadc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:16:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f24ddf98-2f9e-4253-b53b-0b0efcd68a87 tempest-SnapshotDependencyTests-522587893 None] Created volume successfully.
Nov 03 17:16:07 devstack sudo[108609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9
Nov 03 17:16:07 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:07 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9" returned: 0 in 0.381s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:07 devstack sudo[108614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c 1G
Nov 03 17:16:07 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:07 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c 1G" returned: 0 in 0.368s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24680e1-5457-4583-828f-646e26d098e9 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:07 devstack sudo[108620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24680e1-5457-4583-828f-646e26d098e9 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c
Nov 03 17:16:07 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:08 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24680e1-5457-4583-828f-646e26d098e9 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c" returned: 0 in 0.300s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:08 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c is being set with open permissions: ugo+rw
Nov 03 17:16:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:08 devstack sudo[108625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c
Nov 03 17:16:08 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:08 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:08 devstack sudo[108628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.info
Nov 03 17:16:08 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:08 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.info" returned: 0 in 0.269s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:08 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.info is being set with open permissions: ugo+rw
Nov 03 17:16:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:08 devstack sudo[108631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.info
Nov 03 17:16:08 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:08 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.info" returned: 0 in 0.254s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.442s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] Creating offline snapshot 50907737-f181-43af-b3be-d10e554ea366 of volume 7d713cfa-eed9-4c13-b627-ee2660b8de81 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:16:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-679d0c73-8deb-4551-af5a-972ed677b155 tempest-ProjectMemberTests-1397646752 None] Create snapshot completed successfully
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60f3cbd-ef54-4e0d-af01-4f00073cc624]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:09 devstack sudo[108634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81
Nov 03 17:16:09 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-018cd2bc-5d7d-4e69-82cd-d6880b2ac11c-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Lock "cinder-018cd2bc-5d7d-4e69-82cd-d6880b2ac11c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-b24680e1-5457-4583-828f-646e26d098e9" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-b24680e1-5457-4583-828f-646e26d098e9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-018cd2bc-5d7d-4e69-82cd-d6880b2ac11c" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:09 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81" returned: 0 in 0.452s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-018cd2bc-5d7d-4e69-82cd-d6880b2ac11c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Deleting offline snapshot 018cd2bc-5d7d-4e69-82cd-d6880b2ac11c of volume b24680e1-5457-4583-828f-646e26d098e9 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:16:09 devstack sudo[108639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366 1G
Nov 03 17:16:09 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] snapshot_file for this snap is: volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b11172f-9448-4ace-84b7-2dad821c8786]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:09 devstack sudo[108641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c
Nov 03 17:16:09 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:09 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366 1G" returned: 0 in 0.424s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:09 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c" returned: 0 in 0.369s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b24680e1-5457-4583-828f-646e26d098e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:16:09 devstack sudo[108649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366
Nov 03 17:16:09 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:10 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cc5158-b2cf-4512-b439-8ef932d0a8fe]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:10 devstack sudo[108651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9
Nov 03 17:16:10 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:10 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366" returned: 0 in 0.300s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:10 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366 is being set with open permissions: ugo+rw
Nov 03 17:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:10 devstack sudo[108656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366
Nov 03 17:16:10 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:10 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9" returned: 0 in 0.378s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:10 devstack sudo[108661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c
Nov 03 17:16:10 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:10 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:10 devstack sudo[108670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.info
Nov 03 17:16:10 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:10 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c" returned: 0 in 0.380s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:10 devstack sudo[108675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c
Nov 03 17:16:10 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:10 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.info" returned: 0 in 0.271s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:10 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.info is being set with open permissions: ugo+rw
Nov 03 17:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:10 devstack sudo[108678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.info
Nov 03 17:16:10 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:11 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9.018cd2bc-5d7d-4e69-82cd-d6880b2ac11c" returned: 0 in 0.269s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-018cd2bc-5d7d-4e69-82cd-d6880b2ac11c" released by "_delete_snapshot" :: held 1.526s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-b24680e1-5457-4583-828f-646e26d098e9" released by "delete_snapshot" :: held 1.560s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:11 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.info" returned: 0 in 0.269s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e70cb591-bb99-488a-8f10-5b028f6bcb47 tempest-SnapshotDependencyTests-522587893 None] Create snapshot completed successfully
Nov 03 17:16:11 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Created reservations ['f3acc70a-a5de-44a0-8903-f3d0a4aa2cbe', '589fba67-a8bb-45c9-b649-75190bb17de5', '900eb2f3-8dcf-41aa-86d6-b5154e1e3d02', 'ef6c8db2-f36b-4545-97af-255c7f5c1839'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:16:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Delete snapshot completed successfully.
Nov 03 17:16:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3722e304-48e9-4f80-b7a7-6b7ead07ee7f tempest-ProjectMemberTests-1397646752 None] Lock "cinder-018cd2bc-5d7d-4e69-82cd-d6880b2ac11c-delete_snapshot" released by "delete_snapshot" :: held 1.755s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-b24680e1-5457-4583-828f-646e26d098e9-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-b24680e1-5457-4583-828f-646e26d098e9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-b24680e1-5457-4583-828f-646e26d098e9" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-b24680e1-5457-4583-828f-646e26d098e9" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:11 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afde0d6-a6d5-43b0-b438-2fef74723d7c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:11 devstack sudo[108683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9
Nov 03 17:16:11 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:12 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9" returned: 0 in 0.401s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:12 devstack sudo[108688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9
Nov 03 17:16:12 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Flow 'volume_create_manager' (846af566-2ed2-4efe-98b7-bfe7574a6148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:16:12 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0728fa68-a3b8-4bc9-a784-0680d9c2aa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-b24680e1-5457-4583-828f-646e26d098e9" returned: 0 in 0.290s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0728fa68-a3b8-4bc9-a784-0680d9c2aa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=643312f7-22e2-4aa6-8ed3-af43e7ff4a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec987be5c99c4ebeafc8c7fea2a3324a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=50907737-f181-43af-b3be-d10e554ea366,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:12Z,use_quota=True,user_id='1a41a799d4a447c18acd702fcb03d8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b968cf-7d4f-4afa-8700-11cb9046b20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b968cf-7d4f-4afa-8700-11cb9046b20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b003ee68-e07e-49ab-a223-cc2f48eb2aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b003ee68-e07e-49ab-a223-cc2f48eb2aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '643312f7-22e2-4aa6-8ed3-af43e7ff4a7f', 'volume_name': 'volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f', 'volume_size': 1, 'snapshot_id': '50907737-f181-43af-b3be-d10e554ea366'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a4e68e-af4c-47d7-964a-da81c240b7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a4e68e-af4c-47d7-964a-da81c240b7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abee3894-4117-47f9-b1c6-b0dd38df29fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:12 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Volume 643312f7-22e2-4aa6-8ed3-af43e7ff4a7f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f', 'volume_size': 1, 'snapshot_id': '50907737-f181-43af-b3be-d10e554ea366'}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-b24680e1-5457-4583-828f-646e26d098e9" released by "delete_volume" :: held 0.813s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "cinder-quobyte-50907737-f181-43af-b3be-d10e554ea366-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-quobyte-50907737-f181-43af-b3be-d10e554ea366-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Creating volume 643312f7-22e2-4aa6-8ed3-af43e7ff4a7f from snapshot 50907737-f181-43af-b3be-d10e554ea366 {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "cinder-quobyte-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-quobyte-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] snapshot: 50907737-f181-43af-b3be-d10e554ea366, volume: 643312f7-22e2-4aa6-8ed3-af43e7ff4a7f,  {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Created reservations ['2ae24f55-a809-4884-8111-4af5b8478e51', '2247aaef-8bbd-494d-af31-e96c27917a4b', 'e6489868-2b8f-4011-8316-b8201c9896e7', 'f1589770-3643-4ed1-8f58-3f4aef71b00f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[205aefe8-f4a4-44ff-aee9-5b0986e0998d]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:12 devstack sudo[108692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:16:12 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:12 devstack sudo[108691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366
Nov 03 17:16:12 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:13 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:13 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:16:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Deleted volume successfully.
Nov 03 17:16:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2b7524e1-a738-41b2-ac89-e1220ffbcd11 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-b24680e1-5457-4583-828f-646e26d098e9-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:13 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366" returned: 0 in 0.426s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d713cfa-eed9-4c13-b627-ee2660b8de81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:16:13 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce80181-0705-403e-b9dd-b06a6f1e1c9c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:13 devstack sudo[108699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81
Nov 03 17:16:13 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:13 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81" returned: 0 in 0.375s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 17:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 17:16:13 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Path /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 17:16:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:13 devstack sudo[108704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f
Nov 03 17:16:13 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 17:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (e5021648-d7c0-4a4e-8207-45d78c58e7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3601c2c-0192-4d9c-9fc1-1a04e432b3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3601c2c-0192-4d9c-9fc1-1a04e432b3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789791969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fafb27c-19d2-43ce-853c-a9efdc5dba88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:15Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b1e66b-6983-49a2-bdfb-3892c99ce1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b1e66b-6983-49a2-bdfb-3892c99ce1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0eda1e9-add6-488e-af63-51df1bb93ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0eda1e9-add6-488e-af63-51df1bb93ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fafb27c-19d2-43ce-853c-a9efdc5dba88', 'volume_name': 'volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bcacc0-cee4-4553-a04f-85f9dbd7495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bcacc0-cee4-4553-a04f-85f9dbd7495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c25898f-a755-4626-9038-f992cd2f5a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:14 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Volume 3fafb27c-19d2-43ce-853c-a9efdc5dba88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88', 'volume_size': 1}
Nov 03 17:16:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:19 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f" returned: 0 in 5.736s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Image conversion details: src /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 17:16:19 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Converted 1024.00 MB image at 178.48 MB/s
Nov 03 17:16:19 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f is being set with open permissions: ugo+rw
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:19 devstack sudo[108717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f
Nov 03 17:16:19 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:19 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f" returned: 0 in 0.232s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-quobyte-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f" released by "_copy_volume_from_snapshot" :: held 6.870s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-quobyte-50907737-f181-43af-b3be-d10e554ea366-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f" released by "_create_volume_from_snapshot" :: held 6.935s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.963s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.675s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e7245683c50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T16:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789791969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fafb27c-19d2-43ce-853c-a9efdc5dba88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3433b1439c1b4f6ca7bdca68b14fc417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:15Z,use_quota=True,user_id='425453f1fca544f5b32a1a5c563f5471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6afac-f0f1-4fee-8661-02b3c68e1faf),volume_type_id=c8c6afac-f0f1-4fee-8661-02b3c68e1faf)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Creating volume 3fafb27c-19d2-43ce-853c-a9efdc5dba88 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Selected osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 17:16:19 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] casted to osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:19 devstack sudo[108720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88 1073741824
Nov 03 17:16:19 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abee3894-4117-47f9-b1c6-b0dd38df29fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f', 'volume_size': 1, 'snapshot_id': '50907737-f181-43af-b3be-d10e554ea366'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55fca16-ef34-4100-9657-4e79fe067c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Volume volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f (643312f7-22e2-4aa6-8ed3-af43e7ff4a7f): created successfully
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55fca16-ef34-4100-9657-4e79fe067c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Flow 'volume_create_manager' (846af566-2ed2-4efe-98b7-bfe7574a6148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:16:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8efcb90f-fe15-426d-9f01-3d81316ced74 tempest-SnapshotDependencyTests-522587893 None] Created volume successfully.
Nov 03 17:16:19 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88 1073741824" returned: 0 in 0.423s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:20 devstack sudo[108726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88
Nov 03 17:16:20 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "cinder-50907737-f181-43af-b3be-d10e554ea366-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-50907737-f181-43af-b3be-d10e554ea366-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "cinder-quobyte-7d713cfa-eed9-4c13-b627-ee2660b8de81" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-quobyte-7d713cfa-eed9-4c13-b627-ee2660b8de81" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "cinder-quobyte-50907737-f181-43af-b3be-d10e554ea366" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-quobyte-50907737-f181-43af-b3be-d10e554ea366" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Deleting offline snapshot 50907737-f181-43af-b3be-d10e554ea366 of volume 7d713cfa-eed9-4c13-b627-ee2660b8de81 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] snapshot_file for this snap is: volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5781ba-6260-4c2e-8a7b-89dcedc86c36]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:20 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c25898f-a755-4626-9038-f992cd2f5a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9faa78d0-afa2-4d77-a9bb-7e0b76a941e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 17:16:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Volume volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88 (3fafb27c-19d2-43ce-853c-a9efdc5dba88): created successfully
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9faa78d0-afa2-4d77-a9bb-7e0b76a941e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Flow 'volume_create_manager' (e5021648-d7c0-4a4e-8207-45d78c58e7fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 17:16:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-33a1e30a-e50d-4d50-b41b-023f5a987809 tempest-ProjectMemberTests-1397646752 None] Created volume successfully.
Nov 03 17:16:20 devstack sudo[108729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366
Nov 03 17:16:20 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:20 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366" returned: 0 in 0.390s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d713cfa-eed9-4c13-b627-ee2660b8de81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee46ced-03a2-4d3e-a22e-53fe21dc69e4]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:20 devstack sudo[108734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81
Nov 03 17:16:20 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:21 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81" returned: 0 in 0.564s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:21 devstack sudo[108754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366
Nov 03 17:16:21 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] Creating offline snapshot 538ddd71-277c-4e33-a8cd-8f8666a52415 of volume 3fafb27c-19d2-43ce-853c-a9efdc5dba88 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de6103b-a878-47b1-aee3-de1a7be84f78]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:21 devstack sudo[108776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88
Nov 03 17:16:21 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:21 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366" returned: 0 in 0.387s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:21 devstack sudo[108783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366
Nov 03 17:16:21 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:21 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88" returned: 0 in 0.382s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:21 devstack sudo[108788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415 1G
Nov 03 17:16:21 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:21 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81.50907737-f181-43af-b3be-d10e554ea366" returned: 0 in 0.256s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-quobyte-50907737-f181-43af-b3be-d10e554ea366" released by "_delete_snapshot" :: held 1.729s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-quobyte-7d713cfa-eed9-4c13-b627-ee2660b8de81" released by "delete_snapshot" :: held 1.751s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Created reservations ['24e72c2f-b8dc-40f4-bd67-f70cfde6ce2d', '7ffd2b7a-bbb3-422e-98d6-05c01395cca9', '47e27d75-eb25-450d-9cd9-eb8511dea158', '03e67450-e2a0-4776-8cf2-dfa745ee842a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:16:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Delete snapshot completed successfully.
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25cc5870-2091-4986-8022-df7e244bf58b tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-50907737-f181-43af-b3be-d10e554ea366-delete_snapshot" released by "delete_snapshot" :: held 1.901s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:22 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415 1G" returned: 0 in 0.431s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:22 devstack sudo[108795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415
Nov 03 17:16:22 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "cinder-7d713cfa-eed9-4c13-b627-ee2660b8de81-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-7d713cfa-eed9-4c13-b627-ee2660b8de81-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "cinder-quobyte-7d713cfa-eed9-4c13-b627-ee2660b8de81" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-quobyte-7d713cfa-eed9-4c13-b627-ee2660b8de81" acquired by "delete_volume" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:22 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88 -F qcow2 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415" returned: 0 in 0.332s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:22 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415 is being set with open permissions: ugo+rw
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[351b48ee-d09c-4fc9-acb6-037b2a41f53f]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:22 devstack sudo[108800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415
Nov 03 17:16:22 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:22 devstack sudo[108801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81
Nov 03 17:16:22 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:22 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:22 devstack sudo[108805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.info
Nov 03 17:16:22 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:22 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:22 devstack sudo[108810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81
Nov 03 17:16:22 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:23 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.info" returned: 0 in 0.261s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:23 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.info is being set with open permissions: ugo+rw
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:23 devstack sudo[108813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.info
Nov 03 17:16:23 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:23 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-7d713cfa-eed9-4c13-b627-ee2660b8de81" returned: 0 in 0.257s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-quobyte-7d713cfa-eed9-4c13-b627-ee2660b8de81" released by "delete_volume" :: held 0.693s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Created reservations ['f51ddb7c-4279-492e-a2af-21b80a61d2a1', 'b3bc0684-f6b0-42f1-b63d-130ae146c1e6', 'f15d0c29-81b9-42a2-b714-b32a287fb64c', '4fc7d1ef-0969-451e-a7b4-6a7ff55589c2'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:23 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.info" returned: 0 in 0.307s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:23 devstack sudo[108817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:16:23 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.068s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-482decda-be49-4024-948e-ad49a6837dc9 tempest-ProjectMemberTests-1397646752 None] Create snapshot completed successfully
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "cinder-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:23 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.275s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "cinder-quobyte-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Deleted volume successfully.
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-quobyte-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1bd69594-d3ab-4425-9a26-9c6b38c0a1de tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-7d713cfa-eed9-4c13-b627-ee2660b8de81-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef0ed8f-8f01-4761-a306-7e40523b3edf]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:23 devstack sudo[108820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f
Nov 03 17:16:23 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:24 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f" returned: 0 in 0.340s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:24 devstack sudo[108825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f
Nov 03 17:16:24 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:24 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f" returned: 0 in 0.235s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-quobyte-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f" released by "delete_volume" :: held 0.620s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Created reservations ['dec43176-971a-4537-a186-2187bcf95f6a', '6434e40d-d4d1-499f-b05a-4b998dfb0c94', '177f37b3-fc64-471c-822a-c75da27fb663', '38bfab20-7f43-4b98-86af-55135d39a20b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:24 devstack sudo[108828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:16:24 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-538ddd71-277c-4e33-a8cd-8f8666a52415-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-538ddd71-277c-4e33-a8cd-8f8666a52415-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-3fafb27c-19d2-43ce-853c-a9efdc5dba88" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-3fafb27c-19d2-43ce-853c-a9efdc5dba88" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-538ddd71-277c-4e33-a8cd-8f8666a52415" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:24 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.304s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-538ddd71-277c-4e33-a8cd-8f8666a52415" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Deleting offline snapshot 538ddd71-277c-4e33-a8cd-8f8666a52415 of volume 3fafb27c-19d2-43ce-853c-a9efdc5dba88 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] snapshot_file for this snap is: volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 17:16:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Deleted volume successfully.
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4336f161-e5b6-4787-ac2e-37773c88789c]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5f5f8792-a146-4cc2-9d55-a8c7324fdbcb tempest-SnapshotDependencyTests-522587893 None] Lock "cinder-643312f7-22e2-4aa6-8ed3-af43e7ff4a7f-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:24 devstack sudo[108831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415
Nov 03 17:16:24 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:25 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415" returned: 0 in 0.382s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 17:16:25 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[506fed7b-9645-4e0d-8879-e1bc1ed9395e]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:25 devstack sudo[108836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88
Nov 03 17:16:25 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:25 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88" returned: 0 in 0.376s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:25 devstack sudo[108842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415
Nov 03 17:16:25 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:25 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:25 devstack sudo[108847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415
Nov 03 17:16:25 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:26 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88.538ddd71-277c-4e33-a8cd-8f8666a52415" returned: 0 in 0.281s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-538ddd71-277c-4e33-a8cd-8f8666a52415" released by "_delete_snapshot" :: held 1.539s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-3fafb27c-19d2-43ce-853c-a9efdc5dba88" released by "delete_snapshot" :: held 1.574s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:26 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Created reservations ['53f277b0-58e7-477a-8883-2afe6c2ad84f', '16ad099e-04e9-4472-b215-de9cb0f4903b', '752e34a4-5436-4276-b891-6aba770a5634', '02dfaf8d-645a-4378-88ff-c87177869fdb'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:16:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Delete snapshot completed successfully.
Nov 03 17:16:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6417242-8178-4e06-b0de-5f9076d2b370 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-538ddd71-277c-4e33-a8cd-8f8666a52415-delete_snapshot" released by "delete_snapshot" :: held 1.751s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-3fafb27c-19d2-43ce-853c-a9efdc5dba88-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-3fafb27c-19d2-43ce-853c-a9efdc5dba88-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "cinder-quobyte-3fafb27c-19d2-43ce-853c-a9efdc5dba88" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 17:16:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-3fafb27c-19d2-43ce-853c-a9efdc5dba88" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 17:16:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b863f08-8ead-4a2a-a96d-6760f85cf2f0]: (4, 'qcow2') {{(pid=88206) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 17:16:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:27 devstack sudo[108851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88
Nov 03 17:16:27 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:27 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88" returned: 0 in 0.436s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:27 devstack sudo[108856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88
Nov 03 17:16:27 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:27 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5/volume-3fafb27c-19d2-43ce-853c-a9efdc5dba88" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-quobyte-3fafb27c-19d2-43ce-853c-a9efdc5dba88" released by "delete_volume" :: held 0.806s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:27 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Created reservations ['ef9e4c7c-2cee-4111-9521-c271d3a5146f', '5cd4f039-6182-4ecb-8adf-f1ae45f8273c', '7afb009e-8911-4587-a9da-04317f932a63', 'cffc11f0-26cd-465c-ad6c-9958c8001c85'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 17:16:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:16:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:16:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:27 devstack sudo[108859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:16:27 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:28 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:28 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:16:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Deleted volume successfully.
Nov 03 17:16:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9d3537a3-a33e-44a0-a023-833de5758ab8 tempest-ProjectMemberTests-1397646752 None] Lock "cinder-3fafb27c-19d2-43ce-853c-a9efdc5dba88-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 17:16:37 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=63,cinder:UPDATE=90,cinder:INSERT=23,cinder:DELETE=6 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:16:38 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=77,cinder:INSERT=26,cinder:UPDATE=92,cinder:DELETE=9 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 17:16:51 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:16:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 17:16:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 17:16:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 17:16:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-164b1b5c-d6b7-4e7b-9ce8-1f6f3fdb0926'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 17:16:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 17:16:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 17:16:51 devstack sudo[108877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5
Nov 03 17:16:51 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 17:16:52 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root
Nov 03 17:16:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8aea0315051b6adeecf3270ffb0254a5" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 17:16:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 17:16:52 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 17:16:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread count: 29 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 17:16:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-086bf62d-254d-44d0-b760-6d73cd37d7f5 None None] thread info: [<_MainThread(MainThread, started 139029370212480)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139029260773632)>, <Thread(Thread-3 (stat_writer), started daemon 139029255951168)>, <Thread(Rabbit-heartbeat, started daemon 139029256056576)>, <Thread(Thread-5 (_runner), started daemon 139029253724736)>, <Thread(Thread-7 (_runner), started daemon 139029253866816)>, <Thread(fd_logger, started daemon 139029251868480)>, <Thread(privsep_reader, started daemon 139029251404672)>, <Thread(tpool_thread_0, started daemon 139029245134528)>, <Thread(tpool_thread_1, started daemon 139029236741824)>, <Thread(tpool_thread_2, started daemon 139029228349120)>, <Thread(tpool_thread_3, started daemon 139029219956416)>, <Thread(tpool_thread_4, started daemon 139029211563712)>, <Thread(tpool_thread_5, started daemon 139029203171008)>, <Thread(tpool_thread_6, started daemon 139029194778304)>, <Thread(tpool_thread_7, started daemon 139029186385600)>, <Thread(tpool_thread_8, started daemon 139029177992896)>, <Thread(tpool_thread_9, started daemon 139029169600192)>, <Thread(tpool_thread_10, started daemon 139029161207488)>, <Thread(tpool_thread_11, started daemon 139029152814784)>, <Thread(tpool_thread_12, started daemon 139029144422080)>, <Thread(tpool_thread_13, started daemon 139029136029376)>, <Thread(tpool_thread_14, started daemon 139029127636672)>, <Thread(tpool_thread_15, started daemon 139029119243968)>, <Thread(tpool_thread_16, started daemon 139029110851264)>, <Thread(tpool_thread_17, started daemon 139029102458560)>, <Thread(tpool_thread_18, started daemon 139029094065856)>, <Thread(tpool_thread_19, started daemon 139029085656768)>, <Thread(Rabbit-heartbeat, started daemon 139029247180864)>] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}